Max level shown:
12025-08-01T16:00:00.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 35e91551-409a-418d-b84b-b68cc0f91a86 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
22025-08-01T16:00:00.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 35e91551-409a-418d-b84b-b68cc0f91a86 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
32025-08-01T16:00:00.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2631 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 35e91551-409a-418d-b84b-b68cc0f91a86 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
42025-08-01T16:00:01.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 604a33cd-cd6b-4e68-8289-9b5ae62f3a0e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
52025-08-01T16:00:01.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 604a33cd-cd6b-4e68-8289-9b5ae62f3a0e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
62025-08-01T16:00:01.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2220 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 604a33cd-cd6b-4e68-8289-9b5ae62f3a0e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
72025-08-01T16:00:02.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d2292bba-00c0-479c-85b0-2865bcc881ad roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
82025-08-01T16:00:02.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d2292bba-00c0-479c-85b0-2865bcc881ad resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
92025-08-01T16:00:02.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2396 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d2292bba-00c0-479c-85b0-2865bcc881ad response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
102025-08-01T16:00:03.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7dbaf2ca-5cc6-40f0-99be-26eb17a4640a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112025-08-01T16:00:03.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7dbaf2ca-5cc6-40f0-99be-26eb17a4640a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
122025-08-01T16:00:03.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3437 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7dbaf2ca-5cc6-40f0-99be-26eb17a4640a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
132025-08-01T16:00:04.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a489a969-297d-4b95-9c80-ba9abc1aba69 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
142025-08-01T16:00:04.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a489a969-297d-4b95-9c80-ba9abc1aba69 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152025-08-01T16:00:04.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2517 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a489a969-297d-4b95-9c80-ba9abc1aba69 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
162025-08-01T16:00:04.760ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 28 reason = Timeout
172025-08-01T16:00:04.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
182025-08-01T16:00:04.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
192025-08-01T16:00:04.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
202025-08-01T16:00:04.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
212025-08-01T16:00:04.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
222025-08-01T16:00:04.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
232025-08-01T16:00:04.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
242025-08-01T16:00:04.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.516138ms iteration = 28 status = {"chicken_switches_updated":false}
252025-08-01T16:00:05.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = db31e36e-938c-42cd-87e7-630b29def1f4 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
262025-08-01T16:00:05.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = db31e36e-938c-42cd-87e7-630b29def1f4 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
272025-08-01T16:00:05.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2076 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = db31e36e-938c-42cd-87e7-630b29def1f4 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
282025-08-01T16:00:06.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2fd9a8f8-b82b-4f4e-a2ff-507b63a3c0b8 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
292025-08-01T16:00:06.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2fd9a8f8-b82b-4f4e-a2ff-507b63a3c0b8 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
302025-08-01T16:00:06.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1365 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2fd9a8f8-b82b-4f4e-a2ff-507b63a3c0b8 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
312025-08-01T16:00:07.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dcb7b05b-1297-4c89-9b49-0eab3c1a7644 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
322025-08-01T16:00:07.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dcb7b05b-1297-4c89-9b49-0eab3c1a7644 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
332025-08-01T16:00:07.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2777 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dcb7b05b-1297-4c89-9b49-0eab3c1a7644 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
342025-08-01T16:00:08.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 10dc8e00-de3d-4c4a-ab91-077b5467850f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
352025-08-01T16:00:08.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 10dc8e00-de3d-4c4a-ab91-077b5467850f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
362025-08-01T16:00:08.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2540 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 10dc8e00-de3d-4c4a-ab91-077b5467850f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
372025-08-01T16:00:09.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d5cfacd9-7423-4514-8aaa-eddfd495bb8c roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
382025-08-01T16:00:09.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d5cfacd9-7423-4514-8aaa-eddfd495bb8c resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
392025-08-01T16:00:09.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2544 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d5cfacd9-7423-4514-8aaa-eddfd495bb8c response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
402025-08-01T16:00:09.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
412025-08-01T16:00:09.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 29 reason = Timeout
422025-08-01T16:00:09.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
432025-08-01T16:00:09.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
442025-08-01T16:00:09.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
452025-08-01T16:00:09.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
462025-08-01T16:00:09.760ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
472025-08-01T16:00:09.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
482025-08-01T16:00:09.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
492025-08-01T16:00:09.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
502025-08-01T16:00:09.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
512025-08-01T16:00:09.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
522025-08-01T16:00:09.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
532025-08-01T16:00:09.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
542025-08-01T16:00:09.765ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
552025-08-01T16:00:09.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
562025-08-01T16:00:09.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
572025-08-01T16:00:09.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
582025-08-01T16:00:09.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
592025-08-01T16:00:09.767ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
602025-08-01T16:00:09.767ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.294851ms iteration = 29 status = {"chicken_switches_updated":false}
612025-08-01T16:00:09.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
622025-08-01T16:00:09.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
632025-08-01T16:00:09.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
642025-08-01T16:00:09.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
652025-08-01T16:00:09.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
662025-08-01T16:00:09.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
672025-08-01T16:00:09.785ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
682025-08-01T16:00:09.785ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.443231ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
692025-08-01T16:00:09.797ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.200818ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
702025-08-01T16:00:09.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 597 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 4f89ed11-72bf-4220-a581-c20e8f8fbf1b response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
712025-08-01T16:00:10.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cf7dd443-8b82-41dd-91ba-98a772a1ecc1 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
722025-08-01T16:00:10.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cf7dd443-8b82-41dd-91ba-98a772a1ecc1 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
732025-08-01T16:00:10.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2165 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cf7dd443-8b82-41dd-91ba-98a772a1ecc1 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
742025-08-01T16:00:11.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b8806adb-7222-4c81-b4c1-aa99bff4a9aa roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
752025-08-01T16:00:11.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b8806adb-7222-4c81-b4c1-aa99bff4a9aa resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
762025-08-01T16:00:11.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2652 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b8806adb-7222-4c81-b4c1-aa99bff4a9aa response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
772025-08-01T16:00:12.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6cd207a0-c5b3-411a-acd4-bc5b93e022a6 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
782025-08-01T16:00:12.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6cd207a0-c5b3-411a-acd4-bc5b93e022a6 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
792025-08-01T16:00:12.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2728 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6cd207a0-c5b3-411a-acd4-bc5b93e022a6 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
802025-08-01T16:00:13.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 302f0ea4-5cac-45ec-b8bd-e3a439953595 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
812025-08-01T16:00:13.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 302f0ea4-5cac-45ec-b8bd-e3a439953595 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
822025-08-01T16:00:13.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2441 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 302f0ea4-5cac-45ec-b8bd-e3a439953595 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
832025-08-01T16:00:14.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f0b5e4c4-8fc4-4cb1-8516-33e2ed71afa5 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
842025-08-01T16:00:14.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f0b5e4c4-8fc4-4cb1-8516-33e2ed71afa5 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
852025-08-01T16:00:14.760ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 30 reason = Timeout
862025-08-01T16:00:14.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
872025-08-01T16:00:14.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
882025-08-01T16:00:14.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2660 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f0b5e4c4-8fc4-4cb1-8516-33e2ed71afa5 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
892025-08-01T16:00:14.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
902025-08-01T16:00:14.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
912025-08-01T16:00:14.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
922025-08-01T16:00:14.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
932025-08-01T16:00:14.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
942025-08-01T16:00:14.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.527258ms iteration = 30 status = {"chicken_switches_updated":false}
952025-08-01T16:00:14.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47950 req_id = 192ba419-3ab8-4213-bcbd-02c1d746ac57 roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
962025-08-01T16:00:14.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47950 req_id = 192ba419-3ab8-4213-bcbd-02c1d746ac57 resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
972025-08-01T16:00:14.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3113 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47950 req_id = 192ba419-3ab8-4213-bcbd-02c1d746ac57 response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
982025-08-01T16:00:14.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47950 req_id = 3e556957-c349-4580-ab63-2ed69bd36973 roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
992025-08-01T16:00:14.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47950 req_id = 3e556957-c349-4580-ab63-2ed69bd36973 resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
1002025-08-01T16:00:14.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2393 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47950 req_id = 3e556957-c349-4580-ab63-2ed69bd36973 response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
1012025-08-01T16:00:15.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 12f5c939-9488-40bd-bf4e-b59013bf1f59 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
1022025-08-01T16:00:15.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 12f5c939-9488-40bd-bf4e-b59013bf1f59 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
1032025-08-01T16:00:15.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2461 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 12f5c939-9488-40bd-bf4e-b59013bf1f59 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
1042025-08-01T16:00:16.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7a75adc5-34a7-4762-8ce6-fe14253b14df roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
1052025-08-01T16:00:16.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7a75adc5-34a7-4762-8ce6-fe14253b14df resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
1062025-08-01T16:00:16.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2181 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7a75adc5-34a7-4762-8ce6-fe14253b14df response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
1072025-08-01T16:00:17.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7433b710-1e50-488f-a0c9-7f2bdd2a2b1b roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
1082025-08-01T16:00:17.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7433b710-1e50-488f-a0c9-7f2bdd2a2b1b resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
1092025-08-01T16:00:17.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2112 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7433b710-1e50-488f-a0c9-7f2bdd2a2b1b response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
1102025-08-01T16:00:18.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 79fb0d66-0ea5-4006-909a-0ab1497b9427 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
1112025-08-01T16:00:18.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 79fb0d66-0ea5-4006-909a-0ab1497b9427 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
1122025-08-01T16:00:18.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2770 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 79fb0d66-0ea5-4006-909a-0ab1497b9427 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
1132025-08-01T16:00:19.689ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
1142025-08-01T16:00:19.689ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
1152025-08-01T16:00:19.689ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
1162025-08-01T16:00:19.689ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1172025-08-01T16:00:19.689ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1182025-08-01T16:00:19.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1192025-08-01T16:00:19.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1202025-08-01T16:00:19.692ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43715, tv_nsec: 707809288 } })
1212025-08-01T16:00:19.692ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43715, tv_nsec: 707955072 } })
1222025-08-01T16:00:19.692ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.477365ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1232025-08-01T16:00:19.692ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
1242025-08-01T16:00:19.692ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
1252025-08-01T16:00:19.758ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
1262025-08-01T16:00:19.758ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1272025-08-01T16:00:19.759ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd01fae3-436d-413b-8f01-d8199984bee9", "content-length": "26", "date": "Fri, 01 Aug 2025 16:00:19 GMT"} })
1282025-08-01T16:00:19.759ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1292025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 6 reason = Timeout
1302025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
1312025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 22.891\u{b5}s iteration = 6 status = {"disabled":true,"errors":[],"sps":[]}
1322025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
1332025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1342025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
1352025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1362025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
1372025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1382025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1392025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1402025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
1412025-08-01T16:00:19.760ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1422025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1432025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
1442025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1452025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
1462025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1472025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 31 reason = Timeout
1482025-08-01T16:00:19.760ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1492025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
1502025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
1512025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1522025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
1532025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1542025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
1552025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1562025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 6 reason = Timeout
1572025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1582025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
1592025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1602025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 6 reason = Timeout
1612025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
1622025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
1632025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
1642025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1652025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1662025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
1672025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1682025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1692025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1702025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1712025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1722025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
1732025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1742025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1752025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1762025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1772025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1782025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1792025-08-01T16:00:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
1802025-08-01T16:00:19.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1812025-08-01T16:00:19.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1822025-08-01T16:00:19.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1832025-08-01T16:00:19.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1842025-08-01T16:00:19.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
1852025-08-01T16:00:19.761ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
1862025-08-01T16:00:19.761ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1872025-08-01T16:00:19.761ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f9497a5-7cfa-40c8-a931-9de1bd84eec9", "content-length": "26", "date": "Fri, 01 Aug 2025 16:00:19 GMT"} })
1882025-08-01T16:00:19.761ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1892025-08-01T16:00:19.762ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1902025-08-01T16:00:19.764ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1912025-08-01T16:00:19.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1922025-08-01T16:00:19.765ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1932025-08-01T16:00:19.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1942025-08-01T16:00:19.766ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1952025-08-01T16:00:19.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1962025-08-01T16:00:19.767ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1972025-08-01T16:00:19.769ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.293162ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
1982025-08-01T16:00:19.770ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1992025-08-01T16:00:19.770ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2002025-08-01T16:00:19.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2012025-08-01T16:00:19.770ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.477318ms iteration = 6 status = {"errors":[],"finish_invoked_ok":[]}
2022025-08-01T16:00:19.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2032025-08-01T16:00:19.772ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2042025-08-01T16:00:19.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2052025-08-01T16:00:19.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
2062025-08-01T16:00:19.776ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
2072025-08-01T16:00:19.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
2082025-08-01T16:00:19.778ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43715, tv_nsec: 793792845 } })
2092025-08-01T16:00:19.778ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2102025-08-01T16:00:19.778ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
2112025-08-01T16:00:19.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2122025-08-01T16:00:19.781ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
2132025-08-01T16:00:19.781ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 21.726089ms iteration = 31 status = {"chicken_switches_updated":false}
2142025-08-01T16:00:19.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2152025-08-01T16:00:19.820ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2162025-08-01T16:00:19.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2172025-08-01T16:00:19.821ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2182025-08-01T16:00:19.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2192025-08-01T16:00:19.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2202025-08-01T16:00:19.823ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2212025-08-01T16:00:19.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2222025-08-01T16:00:19.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
2232025-08-01T16:00:19.825ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2242025-08-01T16:00:19.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2252025-08-01T16:00:19.825ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2262025-08-01T16:00:19.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2272025-08-01T16:00:19.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2282025-08-01T16:00:19.826ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2292025-08-01T16:00:19.826ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2302025-08-01T16:00:19.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2312025-08-01T16:00:19.827ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2322025-08-01T16:00:19.827ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2332025-08-01T16:00:19.827ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2342025-08-01T16:00:19.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2352025-08-01T16:00:19.828ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 68.245599ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2362025-08-01T16:00:19.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2372025-08-01T16:00:19.829ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2382025-08-01T16:00:19.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2392025-08-01T16:00:19.831ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2402025-08-01T16:00:19.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2412025-08-01T16:00:19.832ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2422025-08-01T16:00:19.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2432025-08-01T16:00:19.833ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2442025-08-01T16:00:19.836ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2452025-08-01T16:00:19.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2462025-08-01T16:00:19.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2472025-08-01T16:00:19.837ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2482025-08-01T16:00:19.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2492025-08-01T16:00:19.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 83fa4635-44e6-4e5f-b90d-50a2f27f1720 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
2502025-08-01T16:00:19.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 83fa4635-44e6-4e5f-b90d-50a2f27f1720 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
2512025-08-01T16:00:19.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2522025-08-01T16:00:19.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2532025-08-01T16:00:19.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2542025-08-01T16:00:19.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2552025-08-01T16:00:19.849ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2562025-08-01T16:00:19.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2572025-08-01T16:00:19.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2582025-08-01T16:00:19.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2592025-08-01T16:00:19.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 14942 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 83fa4635-44e6-4e5f-b90d-50a2f27f1720 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
2602025-08-01T16:00:19.854ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 94.260407ms iteration = 6 status = {"errors":[],"requests_created_ok":[]}
2612025-08-01T16:00:19.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2622025-08-01T16:00:19.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
2632025-08-01T16:00:19.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2642025-08-01T16:00:19.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2652025-08-01T16:00:19.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2662025-08-01T16:00:19.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2672025-08-01T16:00:19.865ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2682025-08-01T16:00:19.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2692025-08-01T16:00:19.867ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2702025-08-01T16:00:19.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
2712025-08-01T16:00:19.870ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2722025-08-01T16:00:19.870ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 181.452422ms iteration = 6 status = {}
2732025-08-01T16:00:19.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2742025-08-01T16:00:19.872ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
2752025-08-01T16:00:19.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2762025-08-01T16:00:19.872ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 112.557293ms iteration = 6 status = 0
2772025-08-01T16:00:19.874ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 zone_address = fd00:1122:3344:101::2
2782025-08-01T16:00:19.874ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2792025-08-01T16:00:19.874ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e9a4bbf-6c5c-4945-b71a-c3c26d43a757", "content-length": "26", "date": "Fri, 01 Aug 2025 16:00:19 GMT"} })
2802025-08-01T16:00:19.874ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2812025-08-01T16:00:19.874ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 185.205276ms iteration = 6 status = null
2822025-08-01T16:00:19.876ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
2832025-08-01T16:00:19.877ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 117.243055ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2842025-08-01T16:00:19.884ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2852025-08-01T16:00:19.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2862025-08-01T16:00:19.885ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2872025-08-01T16:00:19.885ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 125.6783ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2882025-08-01T16:00:19.886ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
2892025-08-01T16:00:19.886ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 125.890267ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
2902025-08-01T16:00:19.886ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2912025-08-01T16:00:19.887ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2922025-08-01T16:00:19.887ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
2932025-08-01T16:00:19.887ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2942025-08-01T16:00:19.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2952025-08-01T16:00:19.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
2962025-08-01T16:00:19.890ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2972025-08-01T16:00:19.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2982025-08-01T16:00:19.899ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 138.84749ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2992025-08-01T16:00:19.908ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3002025-08-01T16:00:19.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3012025-08-01T16:00:19.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 853 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 327d6611-d78c-4db4-9c66-e935d4129ecd response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
3022025-08-01T16:00:19.939ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:391
3032025-08-01T16:00:19.940ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 179.649698ms iteration = 6 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
3042025-08-01T16:00:19.941ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3052025-08-01T16:00:19.941ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
3062025-08-01T16:00:19.941ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 181.659659ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
3072025-08-01T16:00:19.959ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 198.892141ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
3082025-08-01T16:00:19.986ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3092025-08-01T16:00:19.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3102025-08-01T16:00:19.988ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3112025-08-01T16:00:19.991ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3122025-08-01T16:00:19.991ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3132025-08-01T16:00:19.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3142025-08-01T16:00:20.001ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 241.565335ms iteration = 8 status = {"physical_disks_added":0}
3152025-08-01T16:00:20.001ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
3162025-08-01T16:00:20.001ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3172025-08-01T16:00:20.002ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8e08103-cb5f-467d-b304-059ff24e8f09", "content-length": "372", "date": "Fri, 01 Aug 2025 16:00:20 GMT"} })
3182025-08-01T16:00:20.002ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3192025-08-01T16:00:20.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3202025-08-01T16:00:20.011ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3212025-08-01T16:00:20.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3222025-08-01T16:00:20.014ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 3f21d9d5-3adf-463a-a05d-bc2e2e5d64ca, rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(4c7da70d-ede0-4107-abc5-5650a053be38) } rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
3232025-08-01T16:00:20.014ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3242025-08-01T16:00:20.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3252025-08-01T16:00:20.031ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3262025-08-01T16:00:20.036ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3272025-08-01T16:00:20.036ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3282025-08-01T16:00:20.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3292025-08-01T16:00:20.060ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
3302025-08-01T16:00:20.060ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
3312025-08-01T16:00:20.061ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bc6b0615-5c4a-436c-975c-a22cdadda163", "date": "Fri, 01 Aug 2025 16:00:19 GMT"} })
3322025-08-01T16:00:20.061ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3332025-08-01T16:00:20.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3342025-08-01T16:00:20.063ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3352025-08-01T16:00:20.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3362025-08-01T16:00:20.066ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3372025-08-01T16:00:20.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3382025-08-01T16:00:20.070ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
3392025-08-01T16:00:20.070ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3402025-08-01T16:00:20.070ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1670951c-53b9-49af-8fcc-320595922950", "date": "Fri, 01 Aug 2025 16:00:20 GMT"} })
3412025-08-01T16:00:20.072ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 312.110774ms iteration = 6 status = {}
3422025-08-01T16:00:20.073ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
3432025-08-01T16:00:20.073ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "29184b29-5089-404a-8fd5-1dd56c3cb4ae", "content-length": "691", "date": "Fri, 01 Aug 2025 16:00:19 GMT"} })
3442025-08-01T16:00:20.073ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
3452025-08-01T16:00:20.073ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
3462025-08-01T16:00:20.073ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
3472025-08-01T16:00:20.075ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 314.888128ms iteration = 6 status = {}
3482025-08-01T16:00:20.075ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
3492025-08-01T16:00:20.075ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 4c7da70d-ede0-4107-abc5-5650a053be38
3502025-08-01T16:00:20.075ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
3512025-08-01T16:00:20.075ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
3522025-08-01T16:00:20.075ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3532025-08-01T16:00:20.075ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3542025-08-01T16:00:20.075ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3552025-08-01T16:00:20.075ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
3562025-08-01T16:00:20.075ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3572025-08-01T16:00:20.075ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
3582025-08-01T16:00:20.076ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
3592025-08-01T16:00:20.076ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3602025-08-01T16:00:20.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3612025-08-01T16:00:20.078ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
3622025-08-01T16:00:20.078ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
3632025-08-01T16:00:20.187ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3cd123b2-b205-4df1-b873-cb4ec0020d0a", "date": "Fri, 01 Aug 2025 16:00:20 GMT"} })
3642025-08-01T16:00:20.187ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch = Switch0
3652025-08-01T16:00:20.187ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
3662025-08-01T16:00:20.194ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "552a5c33-a08f-42e2-87dc-8d357c5e2648", "content-length": "682", "date": "Fri, 01 Aug 2025 16:00:20 GMT"} })
3672025-08-01T16:00:20.194ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3682025-08-01T16:00:20.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3692025-08-01T16:00:20.198ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3702025-08-01T16:00:20.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3712025-08-01T16:00:20.201ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3722025-08-01T16:00:20.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3732025-08-01T16:00:20.204ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3742025-08-01T16:00:20.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3752025-08-01T16:00:20.216ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 456.371128ms iteration = 6 status = {}
3762025-08-01T16:00:20.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ee373797-3d87-4fcb-867d-0351eca93734 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
3772025-08-01T16:00:20.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ee373797-3d87-4fcb-867d-0351eca93734 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
3782025-08-01T16:00:20.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2604 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ee373797-3d87-4fcb-867d-0351eca93734 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
3792025-08-01T16:00:21.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9a4116b4-bca9-49b7-ac72-769544a806dd roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
3802025-08-01T16:00:21.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9a4116b4-bca9-49b7-ac72-769544a806dd resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
3812025-08-01T16:00:21.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2933 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9a4116b4-bca9-49b7-ac72-769544a806dd response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
3822025-08-01T16:00:22.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f7315f3f-f9c2-422a-b8b8-6697703a85a9 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
3832025-08-01T16:00:22.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f7315f3f-f9c2-422a-b8b8-6697703a85a9 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
3842025-08-01T16:00:22.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2403 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f7315f3f-f9c2-422a-b8b8-6697703a85a9 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
3852025-08-01T16:00:23.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 60bf3ce2-355d-43fb-9e15-5096f5919401 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
3862025-08-01T16:00:23.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 60bf3ce2-355d-43fb-9e15-5096f5919401 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
3872025-08-01T16:00:23.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2306 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 60bf3ce2-355d-43fb-9e15-5096f5919401 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
3882025-08-01T16:00:24.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 32 reason = Timeout
3892025-08-01T16:00:24.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
3902025-08-01T16:00:24.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
3912025-08-01T16:00:24.800ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3922025-08-01T16:00:24.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
3932025-08-01T16:00:24.803ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
3942025-08-01T16:00:24.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
3952025-08-01T16:00:24.805ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
3962025-08-01T16:00:24.805ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 45.891441ms iteration = 32 status = {"chicken_switches_updated":false}
3972025-08-01T16:00:24.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = acde2ebc-bdaa-45a6-bf21-eccc0a240e2a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
3982025-08-01T16:00:24.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = acde2ebc-bdaa-45a6-bf21-eccc0a240e2a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
3992025-08-01T16:00:24.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2288 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = acde2ebc-bdaa-45a6-bf21-eccc0a240e2a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4002025-08-01T16:00:25.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0e950ffb-7347-461b-84b8-2491f7108dc5 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4012025-08-01T16:00:25.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0e950ffb-7347-461b-84b8-2491f7108dc5 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4022025-08-01T16:00:25.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2615 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0e950ffb-7347-461b-84b8-2491f7108dc5 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4032025-08-01T16:00:26.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c34ea758-a2a6-4909-a7a4-1d5b9fa0a89e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4042025-08-01T16:00:26.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c34ea758-a2a6-4909-a7a4-1d5b9fa0a89e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4052025-08-01T16:00:26.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2086 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c34ea758-a2a6-4909-a7a4-1d5b9fa0a89e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4062025-08-01T16:00:27.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a3eb898b-a755-42ad-accd-69f2a28f8de6 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4072025-08-01T16:00:27.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a3eb898b-a755-42ad-accd-69f2a28f8de6 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4082025-08-01T16:00:27.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2103 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a3eb898b-a755-42ad-accd-69f2a28f8de6 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4092025-08-01T16:00:29.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = faed7054-2304-4448-a235-ecba0c9cc005 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4102025-08-01T16:00:29.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = faed7054-2304-4448-a235-ecba0c9cc005 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4112025-08-01T16:00:29.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2446 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = faed7054-2304-4448-a235-ecba0c9cc005 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4122025-08-01T16:00:29.760ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
4132025-08-01T16:00:29.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4142025-08-01T16:00:29.760ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 33 reason = Timeout
4152025-08-01T16:00:29.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
4162025-08-01T16:00:29.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4172025-08-01T16:00:29.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
4182025-08-01T16:00:29.760ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
4192025-08-01T16:00:29.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4202025-08-01T16:00:29.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4212025-08-01T16:00:29.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4222025-08-01T16:00:29.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4232025-08-01T16:00:29.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4242025-08-01T16:00:29.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4252025-08-01T16:00:29.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
4262025-08-01T16:00:29.766ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
4272025-08-01T16:00:29.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
4282025-08-01T16:00:29.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4292025-08-01T16:00:29.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4302025-08-01T16:00:29.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4312025-08-01T16:00:29.767ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
4322025-08-01T16:00:29.767ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.317462ms iteration = 33 status = {"chicken_switches_updated":false}
4332025-08-01T16:00:29.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4342025-08-01T16:00:29.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4352025-08-01T16:00:29.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4362025-08-01T16:00:29.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
4372025-08-01T16:00:29.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4382025-08-01T16:00:29.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4392025-08-01T16:00:29.793ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
4402025-08-01T16:00:29.793ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 33.037242ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
4412025-08-01T16:00:29.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 42.052795ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4422025-08-01T16:00:29.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 550 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 7d641100-7310-49c4-b14d-2974352f9a10 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
4432025-08-01T16:00:30.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a9ee647b-c88b-4a57-b896-8ab6c4511920 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4442025-08-01T16:00:30.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a9ee647b-c88b-4a57-b896-8ab6c4511920 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4452025-08-01T16:00:30.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2573 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a9ee647b-c88b-4a57-b896-8ab6c4511920 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4462025-08-01T16:00:31.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5210ec28-9773-4e16-bef2-8ea3c5c176b7 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4472025-08-01T16:00:31.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5210ec28-9773-4e16-bef2-8ea3c5c176b7 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4482025-08-01T16:00:31.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2593 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5210ec28-9773-4e16-bef2-8ea3c5c176b7 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4492025-08-01T16:00:32.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3225b97f-4238-4b52-b3ea-2ab6ee3ef15f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4502025-08-01T16:00:32.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3225b97f-4238-4b52-b3ea-2ab6ee3ef15f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4512025-08-01T16:00:32.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2100 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3225b97f-4238-4b52-b3ea-2ab6ee3ef15f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4522025-08-01T16:00:33.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df87304b-e865-4e5e-b7fc-2c0790444e73 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4532025-08-01T16:00:33.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df87304b-e865-4e5e-b7fc-2c0790444e73 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4542025-08-01T16:00:33.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2423 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df87304b-e865-4e5e-b7fc-2c0790444e73 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4552025-08-01T16:00:34.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 66073ed1-30b7-4ba4-9ad0-abffb98c3648 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4562025-08-01T16:00:34.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 66073ed1-30b7-4ba4-9ad0-abffb98c3648 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4572025-08-01T16:00:34.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1933 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 66073ed1-30b7-4ba4-9ad0-abffb98c3648 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4582025-08-01T16:00:34.760ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 34 reason = Timeout
4592025-08-01T16:00:34.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
4602025-08-01T16:00:34.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
4612025-08-01T16:00:34.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4622025-08-01T16:00:34.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
4632025-08-01T16:00:34.765ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
4642025-08-01T16:00:34.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
4652025-08-01T16:00:34.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
4662025-08-01T16:00:34.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.074535ms iteration = 34 status = {"chicken_switches_updated":false}
4672025-08-01T16:00:35.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7968cef0-5aff-41f0-a01e-91c8b2587106 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4682025-08-01T16:00:35.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7968cef0-5aff-41f0-a01e-91c8b2587106 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4692025-08-01T16:00:35.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2337 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7968cef0-5aff-41f0-a01e-91c8b2587106 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4702025-08-01T16:00:36.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bea0a4ef-88c5-4ac0-a780-c0a87f360328 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4712025-08-01T16:00:36.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bea0a4ef-88c5-4ac0-a780-c0a87f360328 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4722025-08-01T16:00:36.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2681 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bea0a4ef-88c5-4ac0-a780-c0a87f360328 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4732025-08-01T16:00:37.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 90f22287-23cd-47a7-b923-f11dc05ee5bd roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4742025-08-01T16:00:37.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 90f22287-23cd-47a7-b923-f11dc05ee5bd resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4752025-08-01T16:00:37.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1830 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 90f22287-23cd-47a7-b923-f11dc05ee5bd response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4762025-08-01T16:00:38.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 46734470-0695-401c-b0dd-5ee17a72f9bf roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4772025-08-01T16:00:38.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 46734470-0695-401c-b0dd-5ee17a72f9bf resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4782025-08-01T16:00:38.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2558 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 46734470-0695-401c-b0dd-5ee17a72f9bf response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4792025-08-01T16:00:39.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bcd2be49-90db-4d0e-8080-0394674cb74d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4802025-08-01T16:00:39.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bcd2be49-90db-4d0e-8080-0394674cb74d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4812025-08-01T16:00:39.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2640 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bcd2be49-90db-4d0e-8080-0394674cb74d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
4822025-08-01T16:00:39.760ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
4832025-08-01T16:00:39.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4842025-08-01T16:00:39.760ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 35 reason = Timeout
4852025-08-01T16:00:39.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
4862025-08-01T16:00:39.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4872025-08-01T16:00:39.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
4882025-08-01T16:00:39.760ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
4892025-08-01T16:00:39.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4902025-08-01T16:00:39.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4912025-08-01T16:00:39.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4922025-08-01T16:00:39.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4932025-08-01T16:00:39.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4942025-08-01T16:00:39.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4952025-08-01T16:00:39.764ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.135726ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4962025-08-01T16:00:39.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
4972025-08-01T16:00:39.765ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
4982025-08-01T16:00:39.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
4992025-08-01T16:00:39.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5002025-08-01T16:00:39.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5012025-08-01T16:00:39.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5022025-08-01T16:00:39.767ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
5032025-08-01T16:00:39.767ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.022033ms iteration = 35 status = {"chicken_switches_updated":false}
5042025-08-01T16:00:39.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5052025-08-01T16:00:39.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5062025-08-01T16:00:39.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5072025-08-01T16:00:39.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
5082025-08-01T16:00:39.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5092025-08-01T16:00:39.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5102025-08-01T16:00:39.786ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
5112025-08-01T16:00:39.786ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.417541ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
5122025-08-01T16:00:39.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 517 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 351e9ad7-ed39-4de9-8145-25225487acf1 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
5132025-08-01T16:00:40.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 44d38c8f-debe-4ad1-ab43-f641e451463d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5142025-08-01T16:00:40.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 44d38c8f-debe-4ad1-ab43-f641e451463d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5152025-08-01T16:00:40.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2360 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 44d38c8f-debe-4ad1-ab43-f641e451463d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5162025-08-01T16:00:41.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 216ecac6-bb1e-41f0-84e1-636cc2bccc4a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5172025-08-01T16:00:41.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 216ecac6-bb1e-41f0-84e1-636cc2bccc4a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5182025-08-01T16:00:41.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1928 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 216ecac6-bb1e-41f0-84e1-636cc2bccc4a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5192025-08-01T16:00:42.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ec72c6a6-c1a7-42a6-83d1-6e6195eb9467 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5202025-08-01T16:00:42.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ec72c6a6-c1a7-42a6-83d1-6e6195eb9467 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5212025-08-01T16:00:42.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2772 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ec72c6a6-c1a7-42a6-83d1-6e6195eb9467 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5222025-08-01T16:00:43.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2ec83dba-aee1-4dbe-b33f-265f5c182f57 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5232025-08-01T16:00:43.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2ec83dba-aee1-4dbe-b33f-265f5c182f57 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5242025-08-01T16:00:43.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2533 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2ec83dba-aee1-4dbe-b33f-265f5c182f57 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5252025-08-01T16:00:44.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 63deb71c-856a-47ff-9865-a69f0c12c06b roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5262025-08-01T16:00:44.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 63deb71c-856a-47ff-9865-a69f0c12c06b resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5272025-08-01T16:00:44.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1989 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 63deb71c-856a-47ff-9865-a69f0c12c06b response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5282025-08-01T16:00:44.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 36 reason = Timeout
5292025-08-01T16:00:44.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
5302025-08-01T16:00:44.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
5312025-08-01T16:00:44.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5322025-08-01T16:00:44.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
5332025-08-01T16:00:44.765ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
5342025-08-01T16:00:44.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
5352025-08-01T16:00:44.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
5362025-08-01T16:00:44.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.074095ms iteration = 36 status = {"chicken_switches_updated":false}
5372025-08-01T16:00:45.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df47005c-7aa3-4b3a-9b96-3685e5b8bd22 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5382025-08-01T16:00:45.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df47005c-7aa3-4b3a-9b96-3685e5b8bd22 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5392025-08-01T16:00:45.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2073 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df47005c-7aa3-4b3a-9b96-3685e5b8bd22 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5402025-08-01T16:00:46.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 00b2652e-2e36-4308-8fce-03a199417a5e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5412025-08-01T16:00:46.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 00b2652e-2e36-4308-8fce-03a199417a5e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5422025-08-01T16:00:46.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2378 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 00b2652e-2e36-4308-8fce-03a199417a5e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5432025-08-01T16:00:47.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e2d5a56b-7f1e-4fc8-8945-a9847f68543b roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5442025-08-01T16:00:47.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e2d5a56b-7f1e-4fc8-8945-a9847f68543b resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5452025-08-01T16:00:47.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2320 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e2d5a56b-7f1e-4fc8-8945-a9847f68543b response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5462025-08-01T16:00:48.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2abecc1f-2cc8-4a07-b2ec-2e073ba7909a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5472025-08-01T16:00:48.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2abecc1f-2cc8-4a07-b2ec-2e073ba7909a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5482025-08-01T16:00:48.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2690 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2abecc1f-2cc8-4a07-b2ec-2e073ba7909a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5492025-08-01T16:00:49.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b991d1ef-9fd6-4e35-8a8d-67f55981acfc roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5502025-08-01T16:00:49.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b991d1ef-9fd6-4e35-8a8d-67f55981acfc resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5512025-08-01T16:00:49.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2970 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b991d1ef-9fd6-4e35-8a8d-67f55981acfc response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
5522025-08-01T16:00:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
5532025-08-01T16:00:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
5542025-08-01T16:00:49.688ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
5552025-08-01T16:00:49.688ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
5562025-08-01T16:00:49.688ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-01 15:50:49.688420531 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
5572025-08-01T16:00:49.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5582025-08-01T16:00:49.688ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
5592025-08-01T16:00:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
5602025-08-01T16:00:49.688ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
5612025-08-01T16:00:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
5622025-08-01T16:00:49.688ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
5632025-08-01T16:00:49.688ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
5642025-08-01T16:00:49.688ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5652025-08-01T16:00:49.688ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
5662025-08-01T16:00:49.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5672025-08-01T16:00:49.688ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
5682025-08-01T16:00:49.688ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
5692025-08-01T16:00:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
5702025-08-01T16:00:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
5712025-08-01T16:00:49.688ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
5722025-08-01T16:00:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5732025-08-01T16:00:49.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5742025-08-01T16:00:49.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
5752025-08-01T16:00:49.689ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50fe31de-3241-42df-a386-de37ce323a34.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("58598327-8751-423c-a5ac-c610829651e2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 43745, tv_nsec: 704265602 } })
5762025-08-01T16:00:49.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5772025-08-01T16:00:49.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5782025-08-01T16:00:49.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
5792025-08-01T16:00:49.689ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cb706a84-a33b-442f-aac2-3a6eb5f3b330.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d688a68d-d771-4ac5-8e66-9efa94dbbea8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d688a68d-d771-4ac5-8e66-9efa94dbbea8.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 43745, tv_nsec: 704367485 } })
5802025-08-01T16:00:49.689ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
5812025-08-01T16:00:49.689ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
5822025-08-01T16:00:49.689ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.185336ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
5832025-08-01T16:00:49.689ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.121104ms iteration = 4 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
5842025-08-01T16:00:49.690ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5852025-08-01T16:00:49.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5862025-08-01T16:00:49.690ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5872025-08-01T16:00:49.691ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5882025-08-01T16:00:49.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5892025-08-01T16:00:49.692ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-01 15:50:49.688420531 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5902025-08-01T16:00:49.692ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.96966ms iteration = 4 status = {"expiration":"2025-08-01T15:50:49.688420531Z","pruned":[]}
5912025-08-01T16:00:49.692ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.910058ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5922025-08-01T16:00:49.693ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43745, tv_nsec: 708480610 } })
5932025-08-01T16:00:49.693ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
5942025-08-01T16:00:49.693ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43745, tv_nsec: 708984975 } })
5952025-08-01T16:00:49.693ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
5962025-08-01T16:00:49.694ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5972025-08-01T16:00:49.694ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5982025-08-01T16:00:49.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5992025-08-01T16:00:49.696ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6002025-08-01T16:00:49.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6012025-08-01T16:00:49.698ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6022025-08-01T16:00:49.703ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6032025-08-01T16:00:49.703ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6042025-08-01T16:00:49.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6052025-08-01T16:00:49.707ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
6062025-08-01T16:00:49.707ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1
6072025-08-01T16:00:49.707ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 34.712\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1"}
6082025-08-01T16:00:49.710ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
6092025-08-01T16:00:49.710ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 7 reason = Timeout
6102025-08-01T16:00:49.710ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
6112025-08-01T16:00:49.710ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 8.721\u{b5}s iteration = 7 status = "Disabled"
6122025-08-01T16:00:49.710ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6132025-08-01T16:00:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6142025-08-01T16:00:49.711ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6152025-08-01T16:00:49.711ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 4 reason = Timeout
6162025-08-01T16:00:49.711ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
6172025-08-01T16:00:49.711ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 4 reason = Timeout
6182025-08-01T16:00:49.711ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
6192025-08-01T16:00:49.711ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
6202025-08-01T16:00:49.711ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
6212025-08-01T16:00:49.711ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
6222025-08-01T16:00:49.711ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
6232025-08-01T16:00:49.711ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6242025-08-01T16:00:49.711ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
6252025-08-01T16:00:49.711ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
6262025-08-01T16:00:49.711ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
6272025-08-01T16:00:49.711ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
6282025-08-01T16:00:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6292025-08-01T16:00:49.711ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6302025-08-01T16:00:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
6312025-08-01T16:00:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
6322025-08-01T16:00:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
6332025-08-01T16:00:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6342025-08-01T16:00:49.711ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6352025-08-01T16:00:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6362025-08-01T16:00:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
6372025-08-01T16:00:49.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
6382025-08-01T16:00:49.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6392025-08-01T16:00:49.712ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6402025-08-01T16:00:49.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6412025-08-01T16:00:49.713ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6422025-08-01T16:00:49.716ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6432025-08-01T16:00:49.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6442025-08-01T16:00:49.719ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6452025-08-01T16:00:49.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6462025-08-01T16:00:49.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
6472025-08-01T16:00:49.720ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
6482025-08-01T16:00:49.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
6492025-08-01T16:00:49.722ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6502025-08-01T16:00:49.722ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
6512025-08-01T16:00:49.722ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 10.980733ms iteration = 4 status = {"by_rx":{},"error":null}
6522025-08-01T16:00:49.725ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.483489ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
6532025-08-01T16:00:49.726ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6542025-08-01T16:00:49.726ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6552025-08-01T16:00:49.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6562025-08-01T16:00:49.735ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6572025-08-01T16:00:49.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6582025-08-01T16:00:49.739ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6592025-08-01T16:00:49.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6602025-08-01T16:00:49.739ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6612025-08-01T16:00:49.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6622025-08-01T16:00:49.743ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6632025-08-01T16:00:49.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6642025-08-01T16:00:49.745ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
6652025-08-01T16:00:49.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
6662025-08-01T16:00:49.748ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 37.423415ms iteration = 4 status = {"dispatched":[],"errors":[],"glob_version":"173.0.0","globs_reprocessed":{},"no_receivers":[]}
6672025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 7 reason = Timeout
6682025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
6692025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 28.581\u{b5}s iteration = 7 status = {"disabled":true,"errors":[],"sps":[]}
6702025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
6712025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
6722025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6732025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
6742025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6752025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 7 reason = Timeout
6762025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
6772025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6782025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
6792025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
6802025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
6812025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6822025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
6832025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6842025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
6852025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6862025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
6872025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
6882025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6892025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6902025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
6912025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
6922025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
6932025-08-01T16:00:49.759ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
6942025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6952025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
6962025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6972025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 37 reason = Timeout
6982025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
6992025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
7002025-08-01T16:00:49.759ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7012025-08-01T16:00:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7022025-08-01T16:00:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7032025-08-01T16:00:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
7042025-08-01T16:00:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7052025-08-01T16:00:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7062025-08-01T16:00:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7072025-08-01T16:00:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7082025-08-01T16:00:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7092025-08-01T16:00:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7102025-08-01T16:00:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7112025-08-01T16:00:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
7122025-08-01T16:00:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
7132025-08-01T16:00:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7142025-08-01T16:00:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7152025-08-01T16:00:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
7162025-08-01T16:00:49.761ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 7 reason = Timeout
7172025-08-01T16:00:49.761ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7182025-08-01T16:00:49.761ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
7192025-08-01T16:00:49.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7202025-08-01T16:00:49.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7212025-08-01T16:00:49.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7222025-08-01T16:00:49.763ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7232025-08-01T16:00:49.764ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7242025-08-01T16:00:49.765ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7252025-08-01T16:00:49.765ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
7262025-08-01T16:00:49.765ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7272025-08-01T16:00:49.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7282025-08-01T16:00:49.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7292025-08-01T16:00:49.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
7302025-08-01T16:00:49.768ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7312025-08-01T16:00:49.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7322025-08-01T16:00:49.769ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7332025-08-01T16:00:49.770ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
7342025-08-01T16:00:49.770ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
7352025-08-01T16:00:49.770ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
7362025-08-01T16:00:49.770ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7372025-08-01T16:00:49.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7382025-08-01T16:00:49.771ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7392025-08-01T16:00:49.772ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7402025-08-01T16:00:49.772ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7412025-08-01T16:00:49.773ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7422025-08-01T16:00:49.773ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7432025-08-01T16:00:49.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7442025-08-01T16:00:49.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7452025-08-01T16:00:49.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
7462025-08-01T16:00:49.776ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7472025-08-01T16:00:49.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7482025-08-01T16:00:49.777ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7492025-08-01T16:00:49.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7502025-08-01T16:00:49.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7512025-08-01T16:00:49.779ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7522025-08-01T16:00:49.779ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7532025-08-01T16:00:49.782ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7542025-08-01T16:00:49.783ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7552025-08-01T16:00:49.783ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7562025-08-01T16:00:49.783ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43745, tv_nsec: 798590352 } })
7572025-08-01T16:00:49.783ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
7582025-08-01T16:00:49.784ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
7592025-08-01T16:00:49.784ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7602025-08-01T16:00:49.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7612025-08-01T16:00:49.785ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 25.733181ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7622025-08-01T16:00:49.786ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
7632025-08-01T16:00:49.786ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7642025-08-01T16:00:49.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7652025-08-01T16:00:49.788ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7662025-08-01T16:00:49.788ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7672025-08-01T16:00:49.788ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7682025-08-01T16:00:49.788ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7692025-08-01T16:00:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7702025-08-01T16:00:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7712025-08-01T16:00:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
7722025-08-01T16:00:49.789ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7732025-08-01T16:00:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7742025-08-01T16:00:49.789ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7752025-08-01T16:00:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7762025-08-01T16:00:49.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7772025-08-01T16:00:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
7782025-08-01T16:00:49.791ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
7792025-08-01T16:00:49.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
7802025-08-01T16:00:49.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7812025-08-01T16:00:49.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
7822025-08-01T16:00:49.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7832025-08-01T16:00:49.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7842025-08-01T16:00:49.811ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7852025-08-01T16:00:49.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7862025-08-01T16:00:49.815ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7872025-08-01T16:00:49.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7882025-08-01T16:00:49.825ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
7892025-08-01T16:00:49.825ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
7902025-08-01T16:00:49.825ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 114.11919ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
7912025-08-01T16:00:49.828ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
7922025-08-01T16:00:49.828ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6482e44c-c860-4033-b945-5707d343a59d dns_zone_name = oxide.test found_so_far = 0 version = 2
7932025-08-01T16:00:49.828ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7942025-08-01T16:00:49.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7952025-08-01T16:00:49.830ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 119.896575ms iteration = 3 status = {"nsuccess":5}
7962025-08-01T16:00:49.831ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
7972025-08-01T16:00:49.831ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
7982025-08-01T16:00:49.831ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 120.203584ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
7992025-08-01T16:00:49.836ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8002025-08-01T16:00:49.838ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8012025-08-01T16:00:49.840ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
8022025-08-01T16:00:49.840ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
8032025-08-01T16:00:49.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
8042025-08-01T16:00:49.842ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
8052025-08-01T16:00:49.844ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
8062025-08-01T16:00:49.844ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8072025-08-01T16:00:49.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
8082025-08-01T16:00:49.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8092025-08-01T16:00:49.844ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e1f4d47-27b5-4a54-b51e-3f795e4df3cf", "content-length": "26", "date": "Fri, 01 Aug 2025 16:00:49 GMT"} })
8102025-08-01T16:00:49.844ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8112025-08-01T16:00:49.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8122025-08-01T16:00:49.846ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8132025-08-01T16:00:49.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
8142025-08-01T16:00:49.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
8152025-08-01T16:00:49.849ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
8162025-08-01T16:00:49.849ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8172025-08-01T16:00:49.849ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 89.823243ms iteration = 7 status = {"errors":[],"finish_invoked_ok":[]}
8182025-08-01T16:00:49.849ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6482e44c-c860-4033-b945-5707d343a59d dns_zone_name = oxide.test found_so_far = 4 version = 2
8192025-08-01T16:00:49.849ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
8202025-08-01T16:00:49.849ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-01 15:58:34.713515 UTC dns_group = external generation = 2
8212025-08-01T16:00:49.849ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 161.153797ms iteration = 4 status = {"generation":2}
8222025-08-01T16:00:49.849ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "65d56413-ccca-45c7-a80c-0a2fbedcbec8", "content-length": "26", "date": "Fri, 01 Aug 2025 16:00:49 GMT"} })
8232025-08-01T16:00:49.849ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8242025-08-01T16:00:49.851ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8252025-08-01T16:00:49.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
8262025-08-01T16:00:49.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
8272025-08-01T16:00:49.854ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
8282025-08-01T16:00:49.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
8292025-08-01T16:00:49.858ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 99.013522ms iteration = 7 status = {"errors":[],"requests_created_ok":[]}
8302025-08-01T16:00:49.858ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 99.091604ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
8312025-08-01T16:00:49.860ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8322025-08-01T16:00:49.861ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8332025-08-01T16:00:49.862ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
8342025-08-01T16:00:49.862ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
8352025-08-01T16:00:49.862ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
8362025-08-01T16:00:49.862ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8372025-08-01T16:00:49.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8382025-08-01T16:00:49.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8392025-08-01T16:00:49.865ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8402025-08-01T16:00:49.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8412025-08-01T16:00:49.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
8422025-08-01T16:00:49.865ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
8432025-08-01T16:00:49.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
8442025-08-01T16:00:49.869ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
8452025-08-01T16:00:49.869ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 109.50398ms iteration = 37 status = {"chicken_switches_updated":false}
8462025-08-01T16:00:49.869ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
8472025-08-01T16:00:49.869ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 108.17309ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
8482025-08-01T16:00:49.871ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8492025-08-01T16:00:49.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8502025-08-01T16:00:49.875ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8512025-08-01T16:00:49.876ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8522025-08-01T16:00:49.876ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
8532025-08-01T16:00:49.876ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8542025-08-01T16:00:49.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8552025-08-01T16:00:49.877ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8562025-08-01T16:00:49.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8572025-08-01T16:00:49.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8582025-08-01T16:00:49.878ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8592025-08-01T16:00:49.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8602025-08-01T16:00:49.884ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
8612025-08-01T16:00:49.884ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 124.553147ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
8622025-08-01T16:00:49.891ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
8632025-08-01T16:00:49.914ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8642025-08-01T16:00:49.918ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 158.702822ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
8652025-08-01T16:00:49.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
8662025-08-01T16:00:49.918ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
8672025-08-01T16:00:49.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
8682025-08-01T16:00:49.920ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:391
8692025-08-01T16:00:49.920ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 159.345602ms iteration = 7 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
8702025-08-01T16:00:49.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 569 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 07452e5b-bae4-4d1a-8212-44820c545287 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
8712025-08-01T16:00:49.922ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 zone_address = fd00:1122:3344:101::2
8722025-08-01T16:00:49.922ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8732025-08-01T16:00:49.923ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "38062797-3099-44e9-a8b2-ead012ef50fc", "content-length": "26", "date": "Fri, 01 Aug 2025 16:00:49 GMT"} })
8742025-08-01T16:00:49.923ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8752025-08-01T16:00:49.924ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
8762025-08-01T16:00:49.927ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8772025-08-01T16:00:49.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8782025-08-01T16:00:49.931ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8792025-08-01T16:00:49.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8802025-08-01T16:00:49.933ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 173.720057ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
8812025-08-01T16:00:49.933ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8822025-08-01T16:00:49.937ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-01T15:57:44.766264Z, time_modified: 2025-08-01T15:57:44.766264Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: eec17da7-eb17-4917-8728-908698b69bbe, db_silo: Silo { identity: SiloIdentity { id: eec17da7-eb17-4917-8728-908698b69bbe, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-01T15:58:34.653875Z, time_modified: 2025-08-01T15:58:34.653875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: eec17da7-eb17-4917-8728-908698b69bbe, db_silo: Silo { identity: SiloIdentity { id: eec17da7-eb17-4917-8728-908698b69bbe, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-01T15:58:34.653875Z, time_modified: 2025-08-01T15:58:34.653875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575" }] }) }
8832025-08-01T16:00:49.937ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 249.206627ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"eec17da7-eb17-4917-8728-908698b69bbe","tls_certs":["b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575"]}},"default_endpoint":{"silo_id":"eec17da7-eb17-4917-8728-908698b69bbe","tls_certs":["b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
8842025-08-01T16:00:49.939ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
8852025-08-01T16:00:49.939ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8862025-08-01T16:00:49.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8872025-08-01T16:00:49.941ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 181.862974ms iteration = 7 status = 0
8882025-08-01T16:00:49.942ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 182.319088ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
8892025-08-01T16:00:49.942ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8902025-08-01T16:00:49.947ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8912025-08-01T16:00:49.947ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
8922025-08-01T16:00:49.947ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 187.567738ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
8932025-08-01T16:00:49.948ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
8942025-08-01T16:00:49.948ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8952025-08-01T16:00:49.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8962025-08-01T16:00:49.956ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 197.128437ms iteration = 9 status = {"physical_disks_added":0}
8972025-08-01T16:00:49.961ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
8982025-08-01T16:00:49.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
8992025-08-01T16:00:49.961ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9002025-08-01T16:00:49.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9012025-08-01T16:00:49.977ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9022025-08-01T16:00:49.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9032025-08-01T16:00:49.979ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9042025-08-01T16:00:49.981ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9052025-08-01T16:00:49.981ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9062025-08-01T16:00:49.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9072025-08-01T16:00:49.982ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9082025-08-01T16:00:49.984ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9092025-08-01T16:00:49.984ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9102025-08-01T16:00:49.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9112025-08-01T16:00:49.996ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
9122025-08-01T16:00:49.996ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 02fcb774-aa43-4052-9996-b85e2d1358b5 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
9132025-08-01T16:00:49.996ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
9142025-08-01T16:00:49.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
9152025-08-01T16:00:49.998ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9162025-08-01T16:00:50.001ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
9172025-08-01T16:00:50.001ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
9182025-08-01T16:00:50.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
9192025-08-01T16:00:50.002ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 314.448824ms iteration = 7 status = {}
9202025-08-01T16:00:50.004ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 02fcb774-aa43-4052-9996-b85e2d1358b5 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
9212025-08-01T16:00:50.004ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
9222025-08-01T16:00:50.004ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-01 15:58:34.032744 UTC dns_group = internal generation = 1
9232025-08-01T16:00:50.004ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 316.235109ms iteration = 4 status = {"generation":1}
9242025-08-01T16:00:50.019ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
9252025-08-01T16:00:50.032ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9262025-08-01T16:00:50.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9272025-08-01T16:00:50.035ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 346.990811ms iteration = 7 status = null
9282025-08-01T16:00:50.075ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
9292025-08-01T16:00:50.075ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 364.390689ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
9302025-08-01T16:00:50.125ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
9312025-08-01T16:00:50.125ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ddf387b2-6724-4a53-ba81-d7ff7e7333c3", "date": "Fri, 01 Aug 2025 16:00:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
9322025-08-01T16:00:50.125ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
9332025-08-01T16:00:50.127ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "a9d66567-208a-4345-bec3-cad55318a40a", "date": "Fri, 01 Aug 2025 16:00:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
9342025-08-01T16:00:50.127ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
9352025-08-01T16:00:50.129ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
9362025-08-01T16:00:50.129ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 441.27639ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
9372025-08-01T16:00:50.162ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
9382025-08-01T16:00:50.163ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "119aa8f1-24b2-44dd-b822-c360d9e352d1", "date": "Fri, 01 Aug 2025 16:00:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
9392025-08-01T16:00:50.163ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
9402025-08-01T16:00:50.164ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "c3367d36-6bdc-4c2d-a9bf-7b69c7ef8fd7", "date": "Fri, 01 Aug 2025 16:00:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
9412025-08-01T16:00:50.164ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
9422025-08-01T16:00:50.166ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5a3129b9-f44b-4030-96a0-86b28f95c9e9", "date": "Fri, 01 Aug 2025 16:00:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
9432025-08-01T16:00:50.166ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
9442025-08-01T16:00:50.168ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
9452025-08-01T16:00:50.168ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 479.690485ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
9462025-08-01T16:00:50.179ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
9472025-08-01T16:00:50.180ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d52a6b37-65d4-4319-a768-85aaf3f75639", "content-length": "691", "date": "Fri, 01 Aug 2025 16:00:49 GMT"} })
9482025-08-01T16:00:50.180ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
9492025-08-01T16:00:50.180ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
9502025-08-01T16:00:50.180ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
9512025-08-01T16:00:50.182ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 422.648486ms iteration = 7 status = {}
9522025-08-01T16:00:50.198ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
9532025-08-01T16:00:50.198ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9542025-08-01T16:00:50.200ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d978eedf-3834-4892-8d6e-88a5883906e4", "content-length": "372", "date": "Fri, 01 Aug 2025 16:00:49 GMT"} })
9552025-08-01T16:00:50.200ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9562025-08-01T16:00:50.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9572025-08-01T16:00:50.215ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
9582025-08-01T16:00:50.215ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
9592025-08-01T16:00:50.215ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a875f131-9daf-4a52-a3af-b42b5b119050", "date": "Fri, 01 Aug 2025 16:00:49 GMT"} })
9602025-08-01T16:00:50.215ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9612025-08-01T16:00:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9622025-08-01T16:00:50.218ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9632025-08-01T16:00:50.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9642025-08-01T16:00:50.221ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9652025-08-01T16:00:50.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9662025-08-01T16:00:50.224ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
9672025-08-01T16:00:50.224ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9682025-08-01T16:00:50.228ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a039334f-55f0-48b4-b7c4-e1447db20902", "date": "Fri, 01 Aug 2025 16:00:49 GMT"} })
9692025-08-01T16:00:50.230ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 470.853337ms iteration = 7 status = {}
9702025-08-01T16:00:50.255ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9712025-08-01T16:00:50.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9722025-08-01T16:00:50.258ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 3f21d9d5-3adf-463a-a05d-bc2e2e5d64ca, rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(4c7da70d-ede0-4107-abc5-5650a053be38) } rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
9732025-08-01T16:00:50.258ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9742025-08-01T16:00:50.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9752025-08-01T16:00:50.269ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
9762025-08-01T16:00:50.269ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 4c7da70d-ede0-4107-abc5-5650a053be38
9772025-08-01T16:00:50.269ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
9782025-08-01T16:00:50.269ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
9792025-08-01T16:00:50.269ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9802025-08-01T16:00:50.269ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9812025-08-01T16:00:50.269ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9822025-08-01T16:00:50.269ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
9832025-08-01T16:00:50.269ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9842025-08-01T16:00:50.269ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
9852025-08-01T16:00:50.270ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
9862025-08-01T16:00:50.270ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9872025-08-01T16:00:50.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9882025-08-01T16:00:50.272ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
9892025-08-01T16:00:50.272ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
9902025-08-01T16:00:50.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b7ed314c-7994-475f-9e13-0ef69331d96d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
9912025-08-01T16:00:50.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b7ed314c-7994-475f-9e13-0ef69331d96d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
9922025-08-01T16:00:50.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1860 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b7ed314c-7994-475f-9e13-0ef69331d96d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
9932025-08-01T16:00:50.408ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "22fbcaa2-7c37-4801-b895-881abf53d6dc", "date": "Fri, 01 Aug 2025 16:00:50 GMT"} })
9942025-08-01T16:00:50.408ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch = Switch0
9952025-08-01T16:00:50.408ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
9962025-08-01T16:00:50.408ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cabf3799-af62-4a13-8fb4-769020f45418", "content-length": "682", "date": "Fri, 01 Aug 2025 16:00:50 GMT"} })
9972025-08-01T16:00:50.408ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9982025-08-01T16:00:50.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9992025-08-01T16:00:50.417ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10002025-08-01T16:00:50.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10012025-08-01T16:00:50.421ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10022025-08-01T16:00:50.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10032025-08-01T16:00:50.423ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10042025-08-01T16:00:50.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10052025-08-01T16:00:50.430ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 670.452749ms iteration = 7 status = {}
10062025-08-01T16:00:51.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 85416dfb-d42a-4a29-bf52-208fa27382be roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10072025-08-01T16:00:51.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 85416dfb-d42a-4a29-bf52-208fa27382be resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10082025-08-01T16:00:51.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1862 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 85416dfb-d42a-4a29-bf52-208fa27382be response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10092025-08-01T16:00:52.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d99bceef-25a3-4a42-a245-ee1cca66f777 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10102025-08-01T16:00:52.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d99bceef-25a3-4a42-a245-ee1cca66f777 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10112025-08-01T16:00:52.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2804 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d99bceef-25a3-4a42-a245-ee1cca66f777 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10122025-08-01T16:00:53.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 71d42453-b9f8-41b1-8c36-aed5a8b88484 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10132025-08-01T16:00:53.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 71d42453-b9f8-41b1-8c36-aed5a8b88484 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10142025-08-01T16:00:53.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2118 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 71d42453-b9f8-41b1-8c36-aed5a8b88484 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10152025-08-01T16:00:54.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 81f68e66-4524-48a6-8aba-298848d3f416 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10162025-08-01T16:00:54.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 81f68e66-4524-48a6-8aba-298848d3f416 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10172025-08-01T16:00:54.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2611 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 81f68e66-4524-48a6-8aba-298848d3f416 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10182025-08-01T16:00:54.760ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 38 reason = Timeout
10192025-08-01T16:00:54.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
10202025-08-01T16:00:54.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
10212025-08-01T16:00:54.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10222025-08-01T16:00:54.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
10232025-08-01T16:00:54.765ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
10242025-08-01T16:00:54.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
10252025-08-01T16:00:54.767ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
10262025-08-01T16:00:54.767ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.286521ms iteration = 38 status = {"chicken_switches_updated":false}
10272025-08-01T16:00:55.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2a6edd06-537d-4ae3-bd74-f6d17352096a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10282025-08-01T16:00:55.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2a6edd06-537d-4ae3-bd74-f6d17352096a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10292025-08-01T16:00:55.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2304 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2a6edd06-537d-4ae3-bd74-f6d17352096a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10302025-08-01T16:00:56.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fcfe9918-8404-435f-97fc-f9f42e9fd5c7 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10312025-08-01T16:00:56.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fcfe9918-8404-435f-97fc-f9f42e9fd5c7 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10322025-08-01T16:00:56.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2310 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fcfe9918-8404-435f-97fc-f9f42e9fd5c7 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10332025-08-01T16:00:57.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0be4d2bc-ad4b-4993-94e7-89c2e636075a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10342025-08-01T16:00:57.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0be4d2bc-ad4b-4993-94e7-89c2e636075a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10352025-08-01T16:00:57.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2144 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0be4d2bc-ad4b-4993-94e7-89c2e636075a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10362025-08-01T16:00:58.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 940efa9a-f8b5-474b-bca9-546de9c5a59c roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10372025-08-01T16:00:58.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 940efa9a-f8b5-474b-bca9-546de9c5a59c resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10382025-08-01T16:00:58.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2233 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 940efa9a-f8b5-474b-bca9-546de9c5a59c response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10392025-08-01T16:00:59.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b236ac19-2c26-42cf-ad29-96d15dbdccea roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10402025-08-01T16:00:59.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b236ac19-2c26-42cf-ad29-96d15dbdccea resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10412025-08-01T16:00:59.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2267 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b236ac19-2c26-42cf-ad29-96d15dbdccea response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10422025-08-01T16:00:59.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
10432025-08-01T16:00:59.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10442025-08-01T16:00:59.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 39 reason = Timeout
10452025-08-01T16:00:59.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
10462025-08-01T16:00:59.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10472025-08-01T16:00:59.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
10482025-08-01T16:00:59.760ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
10492025-08-01T16:00:59.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10502025-08-01T16:00:59.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10512025-08-01T16:00:59.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10522025-08-01T16:00:59.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
10532025-08-01T16:00:59.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
10542025-08-01T16:00:59.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
10552025-08-01T16:00:59.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
10562025-08-01T16:00:59.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.833007ms iteration = 39 status = {"chicken_switches_updated":false}
10572025-08-01T16:00:59.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10582025-08-01T16:00:59.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10592025-08-01T16:00:59.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10602025-08-01T16:00:59.797ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.391604ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10612025-08-01T16:00:59.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10622025-08-01T16:00:59.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10632025-08-01T16:00:59.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10642025-08-01T16:00:59.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10652025-08-01T16:00:59.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10662025-08-01T16:00:59.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10672025-08-01T16:00:59.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
10682025-08-01T16:00:59.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10692025-08-01T16:00:59.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10702025-08-01T16:00:59.830ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
10712025-08-01T16:00:59.830ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 69.625801ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
10722025-08-01T16:00:59.914ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::d]:63991
10732025-08-01T16:00:59.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63991 req_id = dc4634f0-0ae5-4390-a7b8-9b9c46096865 roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
10742025-08-01T16:00:59.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63991 req_id = dc4634f0-0ae5-4390-a7b8-9b9c46096865 resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
10752025-08-01T16:00:59.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2646 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63991 req_id = dc4634f0-0ae5-4390-a7b8-9b9c46096865 response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
10762025-08-01T16:00:59.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63991 req_id = efe82499-9a27-4ce7-a803-e44335b7c428 roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
10772025-08-01T16:00:59.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63991 req_id = efe82499-9a27-4ce7-a803-e44335b7c428 resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
10782025-08-01T16:00:59.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2030 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63991 req_id = efe82499-9a27-4ce7-a803-e44335b7c428 response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
10792025-08-01T16:00:59.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 496 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 5cbdd678-4fa2-4f67-a550-279890da2e9d response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
10802025-08-01T16:01:00.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 88849693-4405-4c54-9683-ef5d2aeea432 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10812025-08-01T16:01:00.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 88849693-4405-4c54-9683-ef5d2aeea432 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10822025-08-01T16:01:00.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2283 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 88849693-4405-4c54-9683-ef5d2aeea432 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10832025-08-01T16:01:01.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8d6aaf70-f1c2-49b2-88ee-0142553be8eb roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10842025-08-01T16:01:01.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8d6aaf70-f1c2-49b2-88ee-0142553be8eb resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10852025-08-01T16:01:01.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2584 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8d6aaf70-f1c2-49b2-88ee-0142553be8eb response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10862025-08-01T16:01:02.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = aef78c05-359f-4fb2-b2e6-d10c2b6d24ee roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10872025-08-01T16:01:02.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = aef78c05-359f-4fb2-b2e6-d10c2b6d24ee resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10882025-08-01T16:01:02.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2045 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = aef78c05-359f-4fb2-b2e6-d10c2b6d24ee response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10892025-08-01T16:01:03.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4d577202-ec91-4398-bdf7-caa6f2de695a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10902025-08-01T16:01:03.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4d577202-ec91-4398-bdf7-caa6f2de695a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10912025-08-01T16:01:03.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2244 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4d577202-ec91-4398-bdf7-caa6f2de695a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10922025-08-01T16:01:04.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4a90659b-934c-441d-82b1-6848de4f0c4b roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10932025-08-01T16:01:04.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4a90659b-934c-441d-82b1-6848de4f0c4b resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10942025-08-01T16:01:04.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1536 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4a90659b-934c-441d-82b1-6848de4f0c4b response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
10952025-08-01T16:01:04.760ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 40 reason = Timeout
10962025-08-01T16:01:04.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
10972025-08-01T16:01:04.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
10982025-08-01T16:01:04.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10992025-08-01T16:01:04.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
11002025-08-01T16:01:04.766ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
11012025-08-01T16:01:04.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
11022025-08-01T16:01:04.767ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
11032025-08-01T16:01:04.767ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.432485ms iteration = 40 status = {"chicken_switches_updated":false}
11042025-08-01T16:01:05.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f7a969cb-2e81-42b2-846d-5395f16b7bd8 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11052025-08-01T16:01:05.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f7a969cb-2e81-42b2-846d-5395f16b7bd8 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11062025-08-01T16:01:05.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2534 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f7a969cb-2e81-42b2-846d-5395f16b7bd8 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11072025-08-01T16:01:06.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1bae5d89-6c97-4bfe-8f5f-01c7d41ffe14 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11082025-08-01T16:01:06.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1bae5d89-6c97-4bfe-8f5f-01c7d41ffe14 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11092025-08-01T16:01:06.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2143 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1bae5d89-6c97-4bfe-8f5f-01c7d41ffe14 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11102025-08-01T16:01:07.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fd04fa28-7dc2-4f6d-9213-fa9ad9d8dc58 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11112025-08-01T16:01:07.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fd04fa28-7dc2-4f6d-9213-fa9ad9d8dc58 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11122025-08-01T16:01:07.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2265 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fd04fa28-7dc2-4f6d-9213-fa9ad9d8dc58 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11132025-08-01T16:01:08.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 19b75f19-2659-4207-9812-c429bb4a240c roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11142025-08-01T16:01:08.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 19b75f19-2659-4207-9812-c429bb4a240c resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11152025-08-01T16:01:08.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2082 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 19b75f19-2659-4207-9812-c429bb4a240c response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11162025-08-01T16:01:09.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ce490f9f-c82f-464f-949d-33c9c1c50efa roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11172025-08-01T16:01:09.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ce490f9f-c82f-464f-949d-33c9c1c50efa resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11182025-08-01T16:01:09.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2606 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ce490f9f-c82f-464f-949d-33c9c1c50efa response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11192025-08-01T16:01:09.760ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
11202025-08-01T16:01:09.760ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 41 reason = Timeout
11212025-08-01T16:01:09.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11222025-08-01T16:01:09.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
11232025-08-01T16:01:09.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11242025-08-01T16:01:09.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
11252025-08-01T16:01:09.760ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
11262025-08-01T16:01:09.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11272025-08-01T16:01:09.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11282025-08-01T16:01:09.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11292025-08-01T16:01:09.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11302025-08-01T16:01:09.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
11312025-08-01T16:01:09.766ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
11322025-08-01T16:01:09.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
11332025-08-01T16:01:09.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11342025-08-01T16:01:09.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11352025-08-01T16:01:09.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11362025-08-01T16:01:09.769ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
11372025-08-01T16:01:09.769ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 9.307923ms iteration = 41 status = {"chicken_switches_updated":false}
11382025-08-01T16:01:09.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11392025-08-01T16:01:09.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11402025-08-01T16:01:09.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11412025-08-01T16:01:09.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
11422025-08-01T16:01:09.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11432025-08-01T16:01:09.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11442025-08-01T16:01:09.788ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
11452025-08-01T16:01:09.788ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.37038ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
11462025-08-01T16:01:09.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11472025-08-01T16:01:09.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11482025-08-01T16:01:09.804ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 43.957753ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11492025-08-01T16:01:09.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 470 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = a7d82002-0b13-470f-ad19-166c8be757d6 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
11502025-08-01T16:01:10.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 090fbf0d-589c-4afa-8bae-378b65707c83 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11512025-08-01T16:01:10.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 090fbf0d-589c-4afa-8bae-378b65707c83 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11522025-08-01T16:01:10.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2609 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 090fbf0d-589c-4afa-8bae-378b65707c83 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11532025-08-01T16:01:11.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a469e92b-aefe-493d-987a-adea5c97eef3 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11542025-08-01T16:01:11.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a469e92b-aefe-493d-987a-adea5c97eef3 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11552025-08-01T16:01:11.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2495 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a469e92b-aefe-493d-987a-adea5c97eef3 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11562025-08-01T16:01:12.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8c79f6e7-6ef3-496d-bb55-bc3b5ec00b6f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11572025-08-01T16:01:12.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8c79f6e7-6ef3-496d-bb55-bc3b5ec00b6f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11582025-08-01T16:01:12.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2291 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8c79f6e7-6ef3-496d-bb55-bc3b5ec00b6f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11592025-08-01T16:01:13.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 11ec092d-8813-4dbd-94a2-e97c8f83052f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11602025-08-01T16:01:13.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 11ec092d-8813-4dbd-94a2-e97c8f83052f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11612025-08-01T16:01:13.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2160 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 11ec092d-8813-4dbd-94a2-e97c8f83052f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11622025-08-01T16:01:14.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9bebd09c-6a83-4217-b4b2-a483719b006a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11632025-08-01T16:01:14.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9bebd09c-6a83-4217-b4b2-a483719b006a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11642025-08-01T16:01:14.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1766 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9bebd09c-6a83-4217-b4b2-a483719b006a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11652025-08-01T16:01:14.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 42 reason = Timeout
11662025-08-01T16:01:14.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
11672025-08-01T16:01:14.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
11682025-08-01T16:01:14.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11692025-08-01T16:01:14.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
11702025-08-01T16:01:14.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
11712025-08-01T16:01:14.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
11722025-08-01T16:01:14.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
11732025-08-01T16:01:14.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.431905ms iteration = 42 status = {"chicken_switches_updated":false}
11742025-08-01T16:01:14.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63991 req_id = 3b730162-6d48-446a-bd9b-694f40650a33 roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
11752025-08-01T16:01:14.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63991 req_id = 3b730162-6d48-446a-bd9b-694f40650a33 resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
11762025-08-01T16:01:14.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2520 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63991 req_id = 3b730162-6d48-446a-bd9b-694f40650a33 response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
11772025-08-01T16:01:14.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63991 req_id = caa82dc9-64ec-4c11-a170-3a5430ab10c5 roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
11782025-08-01T16:01:14.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63991 req_id = caa82dc9-64ec-4c11-a170-3a5430ab10c5 resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
11792025-08-01T16:01:14.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2404 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63991 req_id = caa82dc9-64ec-4c11-a170-3a5430ab10c5 response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
11802025-08-01T16:01:15.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9879cec4-78d1-42d0-90e8-e411b1d5225a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11812025-08-01T16:01:15.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9879cec4-78d1-42d0-90e8-e411b1d5225a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11822025-08-01T16:01:15.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1765 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9879cec4-78d1-42d0-90e8-e411b1d5225a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11832025-08-01T16:01:16.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f351d416-bdec-4a5a-b414-0e2f1fdc375f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11842025-08-01T16:01:16.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f351d416-bdec-4a5a-b414-0e2f1fdc375f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11852025-08-01T16:01:16.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2439 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f351d416-bdec-4a5a-b414-0e2f1fdc375f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11862025-08-01T16:01:17.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df88bc80-5f10-4215-a313-8de266b097a1 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11872025-08-01T16:01:17.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df88bc80-5f10-4215-a313-8de266b097a1 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11882025-08-01T16:01:17.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2061 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df88bc80-5f10-4215-a313-8de266b097a1 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11892025-08-01T16:01:18.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = eba659a9-27b2-42c1-9ee3-0e0f1714c0b2 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11902025-08-01T16:01:18.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = eba659a9-27b2-42c1-9ee3-0e0f1714c0b2 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11912025-08-01T16:01:18.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2392 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = eba659a9-27b2-42c1-9ee3-0e0f1714c0b2 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
11922025-08-01T16:01:19.688ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
11932025-08-01T16:01:19.688ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
11942025-08-01T16:01:19.688ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
11952025-08-01T16:01:19.688ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11962025-08-01T16:01:19.688ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
11972025-08-01T16:01:19.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11982025-08-01T16:01:19.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
11992025-08-01T16:01:19.690ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43775, tv_nsec: 706019429 } })
12002025-08-01T16:01:19.690ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
12012025-08-01T16:01:19.691ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43775, tv_nsec: 707125833 } })
12022025-08-01T16:01:19.692ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
12032025-08-01T16:01:19.692ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.082084ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
12042025-08-01T16:01:19.759ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 8 reason = Timeout
12052025-08-01T16:01:19.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
12062025-08-01T16:01:19.759ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 25.391\u{b5}s iteration = 8 status = {"disabled":true,"errors":[],"sps":[]}
12072025-08-01T16:01:19.759ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
12082025-08-01T16:01:19.759ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
12092025-08-01T16:01:19.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12102025-08-01T16:01:19.759ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12112025-08-01T16:01:19.759ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
12122025-08-01T16:01:19.759ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
12132025-08-01T16:01:19.759ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 8 reason = Timeout
12142025-08-01T16:01:19.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
12152025-08-01T16:01:19.759ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
12162025-08-01T16:01:19.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
12172025-08-01T16:01:19.759ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
12182025-08-01T16:01:19.759ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
12192025-08-01T16:01:19.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
12202025-08-01T16:01:19.759ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12212025-08-01T16:01:19.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
12222025-08-01T16:01:19.759ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
12232025-08-01T16:01:19.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
12242025-08-01T16:01:19.759ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12252025-08-01T16:01:19.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
12262025-08-01T16:01:19.759ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
12272025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12282025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
12292025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
12302025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
12312025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12322025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 43 reason = Timeout
12332025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
12342025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
12352025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12362025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
12372025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12382025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
12392025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 8 reason = Timeout
12402025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
12412025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
12422025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12432025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
12442025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12452025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12462025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
12472025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12482025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12492025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
12502025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
12512025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12522025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12532025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12542025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12552025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
12562025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
12572025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12582025-08-01T16:01:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
12592025-08-01T16:01:19.761ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12602025-08-01T16:01:19.763ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12612025-08-01T16:01:19.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12622025-08-01T16:01:19.764ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12632025-08-01T16:01:19.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12642025-08-01T16:01:19.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
12652025-08-01T16:01:19.766ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
12662025-08-01T16:01:19.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
12672025-08-01T16:01:19.767ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12682025-08-01T16:01:19.767ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12692025-08-01T16:01:19.767ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12702025-08-01T16:01:19.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12712025-08-01T16:01:19.767ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
12722025-08-01T16:01:19.767ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12732025-08-01T16:01:19.768ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1a54dad-3d7d-4d76-8569-5ca4a85a3731", "content-length": "26", "date": "Fri, 01 Aug 2025 16:01:19 GMT"} })
12742025-08-01T16:01:19.768ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12752025-08-01T16:01:19.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12762025-08-01T16:01:19.768ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12772025-08-01T16:01:19.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
12782025-08-01T16:01:19.769ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
12792025-08-01T16:01:19.770ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12802025-08-01T16:01:19.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
12812025-08-01T16:01:19.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12822025-08-01T16:01:19.770ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12832025-08-01T16:01:19.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
12842025-08-01T16:01:19.773ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12852025-08-01T16:01:19.773ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
12862025-08-01T16:01:19.773ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 13.5324ms iteration = 43 status = {"chicken_switches_updated":false}
12872025-08-01T16:01:19.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12882025-08-01T16:01:19.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
12892025-08-01T16:01:19.773ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12902025-08-01T16:01:19.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12912025-08-01T16:01:19.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
12922025-08-01T16:01:19.774ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12932025-08-01T16:01:19.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12942025-08-01T16:01:19.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
12952025-08-01T16:01:19.775ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
12962025-08-01T16:01:19.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
12972025-08-01T16:01:19.776ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12982025-08-01T16:01:19.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12992025-08-01T16:01:19.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13002025-08-01T16:01:19.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13012025-08-01T16:01:19.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13022025-08-01T16:01:19.777ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13032025-08-01T16:01:19.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13042025-08-01T16:01:19.778ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
13052025-08-01T16:01:19.778ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13062025-08-01T16:01:19.779ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "418e49bf-e8ba-405e-bda1-3d283386903f", "content-length": "26", "date": "Fri, 01 Aug 2025 16:01:19 GMT"} })
13072025-08-01T16:01:19.779ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13082025-08-01T16:01:19.781ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
13092025-08-01T16:01:19.781ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13102025-08-01T16:01:19.785ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43775, tv_nsec: 801089482 } })
13112025-08-01T16:01:19.786ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
13122025-08-01T16:01:19.786ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13132025-08-01T16:01:19.786ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13142025-08-01T16:01:19.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13152025-08-01T16:01:19.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13162025-08-01T16:01:19.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13172025-08-01T16:01:19.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13182025-08-01T16:01:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
13192025-08-01T16:01:19.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13202025-08-01T16:01:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13212025-08-01T16:01:19.813ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13222025-08-01T16:01:19.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13232025-08-01T16:01:19.820ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13242025-08-01T16:01:19.823ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13252025-08-01T16:01:19.823ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13262025-08-01T16:01:19.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13272025-08-01T16:01:19.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fe39669c-eed3-4253-9683-290f7ddec03a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
13282025-08-01T16:01:19.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fe39669c-eed3-4253-9683-290f7ddec03a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
13292025-08-01T16:01:19.836ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 77.036696ms iteration = 8 status = {"errors":[],"finish_invoked_ok":[]}
13302025-08-01T16:01:19.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2741 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fe39669c-eed3-4253-9683-290f7ddec03a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
13312025-08-01T16:01:19.838ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
13322025-08-01T16:01:19.839ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 79.236342ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
13332025-08-01T16:01:19.839ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
13342025-08-01T16:01:19.839ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 79.450279ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
13352025-08-01T16:01:19.841ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13362025-08-01T16:01:19.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13372025-08-01T16:01:19.841ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13382025-08-01T16:01:19.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13392025-08-01T16:01:19.841ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 82.13998ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
13402025-08-01T16:01:19.842ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13412025-08-01T16:01:19.842ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
13422025-08-01T16:01:19.842ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13432025-08-01T16:01:19.842ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 82.443519ms iteration = 8 status = {"errors":[],"requests_created_ok":[]}
13442025-08-01T16:01:19.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13452025-08-01T16:01:19.843ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13462025-08-01T16:01:19.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
13472025-08-01T16:01:19.843ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 83.898944ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
13482025-08-01T16:01:19.845ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13492025-08-01T16:01:19.845ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
13502025-08-01T16:01:19.845ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13512025-08-01T16:01:19.845ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13522025-08-01T16:01:19.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13532025-08-01T16:01:19.847ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 87.874794ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13542025-08-01T16:01:19.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
13552025-08-01T16:01:19.848ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13562025-08-01T16:01:19.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
13572025-08-01T16:01:19.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13582025-08-01T16:01:19.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13592025-08-01T16:01:19.857ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13602025-08-01T16:01:19.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13612025-08-01T16:01:19.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13622025-08-01T16:01:19.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
13632025-08-01T16:01:19.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13642025-08-01T16:01:19.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13652025-08-01T16:01:19.865ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 105.259201ms iteration = 8 status = 0
13662025-08-01T16:01:19.880ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 120.232646ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
13672025-08-01T16:01:19.891ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:391
13682025-08-01T16:01:19.891ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 131.425725ms iteration = 8 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
13692025-08-01T16:01:19.892ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 zone_address = fd00:1122:3344:101::2
13702025-08-01T16:01:19.892ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13712025-08-01T16:01:19.892ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "90f992fc-7116-4c70-9b7f-2a88c0ca3884", "content-length": "26", "date": "Fri, 01 Aug 2025 16:01:19 GMT"} })
13722025-08-01T16:01:19.892ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13732025-08-01T16:01:19.893ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
13742025-08-01T16:01:19.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13752025-08-01T16:01:19.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13762025-08-01T16:01:19.897ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 138.085407ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
13772025-08-01T16:01:19.898ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13782025-08-01T16:01:19.898ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
13792025-08-01T16:01:19.898ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 138.673094ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
13802025-08-01T16:01:19.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 609 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = c629e996-037a-4818-9b9a-0e111c246576 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
13812025-08-01T16:01:19.930ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13822025-08-01T16:01:19.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13832025-08-01T16:01:19.944ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 184.984229ms iteration = 10 status = {"physical_disks_added":0}
13842025-08-01T16:01:19.962ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 274.694859ms iteration = 8 status = {}
13852025-08-01T16:01:19.987ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13862025-08-01T16:01:19.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13872025-08-01T16:01:19.989ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 301.325767ms iteration = 8 status = null
13882025-08-01T16:01:20.016ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
13892025-08-01T16:01:20.016ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13902025-08-01T16:01:20.016ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "64042c60-7fe9-4d1c-aea0-1348d22a2980", "content-length": "372", "date": "Fri, 01 Aug 2025 16:01:19 GMT"} })
13912025-08-01T16:01:20.016ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13922025-08-01T16:01:20.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13932025-08-01T16:01:20.053ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13942025-08-01T16:01:20.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13952025-08-01T16:01:20.055ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13962025-08-01T16:01:20.057ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13972025-08-01T16:01:20.057ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13982025-08-01T16:01:20.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13992025-08-01T16:01:20.059ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14002025-08-01T16:01:20.061ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14012025-08-01T16:01:20.061ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14022025-08-01T16:01:20.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14032025-08-01T16:01:20.065ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14042025-08-01T16:01:20.065ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
14052025-08-01T16:01:20.065ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
14062025-08-01T16:01:20.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14072025-08-01T16:01:20.067ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "70a039d2-471a-4f2f-80ee-d2ef3b128bdb", "date": "Fri, 01 Aug 2025 16:01:19 GMT"} })
14082025-08-01T16:01:20.067ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14092025-08-01T16:01:20.067ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 3f21d9d5-3adf-463a-a05d-bc2e2e5d64ca, rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(4c7da70d-ede0-4107-abc5-5650a053be38) } rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
14102025-08-01T16:01:20.067ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14112025-08-01T16:01:20.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14122025-08-01T16:01:20.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14132025-08-01T16:01:20.069ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14142025-08-01T16:01:20.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14152025-08-01T16:01:20.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14162025-08-01T16:01:20.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14172025-08-01T16:01:20.075ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
14182025-08-01T16:01:20.075ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14192025-08-01T16:01:20.079ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
14202025-08-01T16:01:20.079ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 4c7da70d-ede0-4107-abc5-5650a053be38
14212025-08-01T16:01:20.079ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
14222025-08-01T16:01:20.079ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
14232025-08-01T16:01:20.079ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14242025-08-01T16:01:20.079ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14252025-08-01T16:01:20.079ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14262025-08-01T16:01:20.079ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
14272025-08-01T16:01:20.079ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14282025-08-01T16:01:20.079ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
14292025-08-01T16:01:20.080ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
14302025-08-01T16:01:20.080ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14312025-08-01T16:01:20.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14322025-08-01T16:01:20.082ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1a5ec07b-943c-4ce9-8cc1-d5bafefffd6b", "date": "Fri, 01 Aug 2025 16:01:20 GMT"} })
14332025-08-01T16:01:20.082ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
14342025-08-01T16:01:20.082ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
14352025-08-01T16:01:20.084ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 324.413666ms iteration = 8 status = {}
14362025-08-01T16:01:20.094ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
14372025-08-01T16:01:20.095ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "37e4f99f-96cd-4437-a5e9-7c0f56b36bfe", "content-length": "691", "date": "Fri, 01 Aug 2025 16:01:19 GMT"} })
14382025-08-01T16:01:20.095ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
14392025-08-01T16:01:20.095ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
14402025-08-01T16:01:20.095ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
14412025-08-01T16:01:20.097ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 337.101851ms iteration = 8 status = {}
14422025-08-01T16:01:20.224ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bcc656c7-e32f-471f-9137-b49e4eca1d24", "date": "Fri, 01 Aug 2025 16:01:19 GMT"} })
14432025-08-01T16:01:20.224ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch = Switch0
14442025-08-01T16:01:20.224ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
14452025-08-01T16:01:20.224ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f47c41a3-7ba8-4380-ad40-9305f866958d", "content-length": "682", "date": "Fri, 01 Aug 2025 16:01:19 GMT"} })
14462025-08-01T16:01:20.224ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14472025-08-01T16:01:20.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14482025-08-01T16:01:20.228ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14492025-08-01T16:01:20.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14502025-08-01T16:01:20.231ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14512025-08-01T16:01:20.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14522025-08-01T16:01:20.234ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14532025-08-01T16:01:20.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14542025-08-01T16:01:20.240ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 481.020176ms iteration = 8 status = {}
14552025-08-01T16:01:20.506ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 1
14562025-08-01T16:01:20.506ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221
14572025-08-01T16:01:20.537ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
14582025-08-01T16:01:20.537ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:44792
14592025-08-01T16:01:20.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:44792 req_id = 6aa0b5b8-0be7-4de7-b457-f6c47b7a8f68 roles = RoleSet { roles: {} } uri = /metrics/producers
14602025-08-01T16:01:20.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:44792 req_id = 6aa0b5b8-0be7-4de7-b457-f6c47b7a8f68 resource = Database result = Ok(()) uri = /metrics/producers
14612025-08-01T16:01:20.577ZINFOnexus: assigned collector to new producer collector_id = 7bf2727d-8ae8-417c-81cf-59aa0ad1690b file = nexus/src/app/oximeter.rs:76 producer_id = 7248190d-c184-423c-8431-31fe40a79e2e
14622025-08-01T16:01:20.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 40155 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:44792 req_id = 6aa0b5b8-0be7-4de7-b457-f6c47b7a8f68 response_code = 201 uri = /metrics/producers
14632025-08-01T16:01:20.577ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "6aa0b5b8-0be7-4de7-b457-f6c47b7a8f68", "content-length": "41", "date": "Fri, 01 Aug 2025 16:01:19 GMT"} })
14642025-08-01T16:01:20.579ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
14652025-08-01T16:01:20.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0f3d2f6d-97cf-4361-9379-c4aa135dcc40 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
14662025-08-01T16:01:20.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0f3d2f6d-97cf-4361-9379-c4aa135dcc40 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
14672025-08-01T16:01:20.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1913 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0f3d2f6d-97cf-4361-9379-c4aa135dcc40 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
14682025-08-01T16:01:21.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c019c744-80ec-4087-a617-5c74ee35bfe3 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
14692025-08-01T16:01:21.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c019c744-80ec-4087-a617-5c74ee35bfe3 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
14702025-08-01T16:01:21.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2304 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c019c744-80ec-4087-a617-5c74ee35bfe3 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
14712025-08-01T16:01:22.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 528ce218-3c9e-4a94-af18-400b6a9661c4 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
14722025-08-01T16:01:22.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 528ce218-3c9e-4a94-af18-400b6a9661c4 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
14732025-08-01T16:01:22.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2404 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 528ce218-3c9e-4a94-af18-400b6a9661c4 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
14742025-08-01T16:01:23.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8d1055de-a6b8-49c0-bfd8-979a3f138c57 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
14752025-08-01T16:01:23.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8d1055de-a6b8-49c0-bfd8-979a3f138c57 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
14762025-08-01T16:01:23.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2262 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8d1055de-a6b8-49c0-bfd8-979a3f138c57 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
14772025-08-01T16:01:24.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 44 reason = Timeout
14782025-08-01T16:01:24.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
14792025-08-01T16:01:24.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
14802025-08-01T16:01:24.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14812025-08-01T16:01:24.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
14822025-08-01T16:01:24.765ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
14832025-08-01T16:01:24.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
14842025-08-01T16:01:24.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
14852025-08-01T16:01:24.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.519028ms iteration = 44 status = {"chicken_switches_updated":false}
14862025-08-01T16:01:24.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 851287c6-0988-4645-be2f-dad641f6f9fe roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
14872025-08-01T16:01:24.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 851287c6-0988-4645-be2f-dad641f6f9fe resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
14882025-08-01T16:01:24.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2256 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 851287c6-0988-4645-be2f-dad641f6f9fe response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
14892025-08-01T16:01:25.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 91bcd605-17e9-41ad-96f5-a473077b22a2 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
14902025-08-01T16:01:25.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 91bcd605-17e9-41ad-96f5-a473077b22a2 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
14912025-08-01T16:01:25.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2550 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 91bcd605-17e9-41ad-96f5-a473077b22a2 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
14922025-08-01T16:01:26.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 690e9902-bd3f-411d-91fa-18b7dd302438 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
14932025-08-01T16:01:26.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 690e9902-bd3f-411d-91fa-18b7dd302438 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
14942025-08-01T16:01:26.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3978 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 690e9902-bd3f-411d-91fa-18b7dd302438 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
14952025-08-01T16:01:27.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3107b13c-f3cc-4850-b2c4-e5137c800a36 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
14962025-08-01T16:01:27.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3107b13c-f3cc-4850-b2c4-e5137c800a36 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
14972025-08-01T16:01:27.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2233 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3107b13c-f3cc-4850-b2c4-e5137c800a36 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
14982025-08-01T16:01:28.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e6fca351-7541-4199-aee1-604753e29a65 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
14992025-08-01T16:01:28.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e6fca351-7541-4199-aee1-604753e29a65 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15002025-08-01T16:01:28.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2191 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e6fca351-7541-4199-aee1-604753e29a65 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15012025-08-01T16:01:29.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
15022025-08-01T16:01:29.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15032025-08-01T16:01:29.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 45 reason = Timeout
15042025-08-01T16:01:29.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
15052025-08-01T16:01:29.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15062025-08-01T16:01:29.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
15072025-08-01T16:01:29.760ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
15082025-08-01T16:01:29.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15092025-08-01T16:01:29.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15102025-08-01T16:01:29.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15112025-08-01T16:01:29.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15122025-08-01T16:01:29.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15132025-08-01T16:01:29.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15142025-08-01T16:01:29.763ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.740874ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15152025-08-01T16:01:29.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
15162025-08-01T16:01:29.765ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
15172025-08-01T16:01:29.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
15182025-08-01T16:01:29.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15192025-08-01T16:01:29.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15202025-08-01T16:01:29.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15212025-08-01T16:01:29.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
15222025-08-01T16:01:29.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.199108ms iteration = 45 status = {"chicken_switches_updated":false}
15232025-08-01T16:01:29.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15242025-08-01T16:01:29.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15252025-08-01T16:01:29.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15262025-08-01T16:01:29.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
15272025-08-01T16:01:29.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15282025-08-01T16:01:29.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15292025-08-01T16:01:29.789ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
15302025-08-01T16:01:29.789ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 29.186796ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
15312025-08-01T16:01:29.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 541 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = d4f05452-2510-4fb9-ac62-b3a7795b5fda response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
15322025-08-01T16:01:30.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 948553c6-23d6-4fa9-a7e4-369c3df1ced5 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15332025-08-01T16:01:30.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 948553c6-23d6-4fa9-a7e4-369c3df1ced5 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15342025-08-01T16:01:30.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1986 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 948553c6-23d6-4fa9-a7e4-369c3df1ced5 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15352025-08-01T16:01:31.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4089bf75-7196-4592-91de-a39056d03362 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15362025-08-01T16:01:31.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4089bf75-7196-4592-91de-a39056d03362 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15372025-08-01T16:01:31.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2075 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4089bf75-7196-4592-91de-a39056d03362 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15382025-08-01T16:01:32.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 552e7221-0ec3-4f0c-ab1f-f1d33ca5b8b1 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15392025-08-01T16:01:32.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 552e7221-0ec3-4f0c-ab1f-f1d33ca5b8b1 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15402025-08-01T16:01:32.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2024 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 552e7221-0ec3-4f0c-ab1f-f1d33ca5b8b1 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15412025-08-01T16:01:33.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d9369120-a895-45e2-acf4-70a3e25d7d4f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15422025-08-01T16:01:33.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d9369120-a895-45e2-acf4-70a3e25d7d4f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15432025-08-01T16:01:33.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2126 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d9369120-a895-45e2-acf4-70a3e25d7d4f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15442025-08-01T16:01:34.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 46434f98-3fde-4740-a7a9-77a1071f4d08 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15452025-08-01T16:01:34.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 46434f98-3fde-4740-a7a9-77a1071f4d08 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15462025-08-01T16:01:34.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2219 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 46434f98-3fde-4740-a7a9-77a1071f4d08 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15472025-08-01T16:01:34.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 46 reason = Timeout
15482025-08-01T16:01:34.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
15492025-08-01T16:01:34.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
15502025-08-01T16:01:34.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15512025-08-01T16:01:34.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
15522025-08-01T16:01:34.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
15532025-08-01T16:01:34.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
15542025-08-01T16:01:34.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
15552025-08-01T16:01:34.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.031232ms iteration = 46 status = {"chicken_switches_updated":false}
15562025-08-01T16:01:35.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e1d6793d-ae6c-45f8-aa87-dc52a871f95c roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15572025-08-01T16:01:35.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e1d6793d-ae6c-45f8-aa87-dc52a871f95c resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15582025-08-01T16:01:35.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2917 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e1d6793d-ae6c-45f8-aa87-dc52a871f95c response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15592025-08-01T16:01:36.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a7f7351e-0ec9-495b-bf52-54b916431328 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15602025-08-01T16:01:36.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a7f7351e-0ec9-495b-bf52-54b916431328 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15612025-08-01T16:01:36.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1954 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a7f7351e-0ec9-495b-bf52-54b916431328 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15622025-08-01T16:01:37.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fea263b5-a437-49fb-b8bf-deb15fb7f609 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15632025-08-01T16:01:37.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fea263b5-a437-49fb-b8bf-deb15fb7f609 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15642025-08-01T16:01:37.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2130 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fea263b5-a437-49fb-b8bf-deb15fb7f609 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15652025-08-01T16:01:38.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7fa98bf3-f808-4db4-b51b-9685db30953a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15662025-08-01T16:01:38.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7fa98bf3-f808-4db4-b51b-9685db30953a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15672025-08-01T16:01:38.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2542 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7fa98bf3-f808-4db4-b51b-9685db30953a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15682025-08-01T16:01:39.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4cb9e699-5ef4-48a5-a174-8e81ab1bf3fa roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15692025-08-01T16:01:39.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4cb9e699-5ef4-48a5-a174-8e81ab1bf3fa resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15702025-08-01T16:01:39.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2781 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4cb9e699-5ef4-48a5-a174-8e81ab1bf3fa response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
15712025-08-01T16:01:39.760ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
15722025-08-01T16:01:39.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15732025-08-01T16:01:39.760ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 47 reason = Timeout
15742025-08-01T16:01:39.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
15752025-08-01T16:01:39.760ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
15762025-08-01T16:01:39.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15772025-08-01T16:01:39.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15782025-08-01T16:01:39.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
15792025-08-01T16:01:39.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15802025-08-01T16:01:39.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15812025-08-01T16:01:39.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15822025-08-01T16:01:39.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15832025-08-01T16:01:39.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15842025-08-01T16:01:39.763ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.582548ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15852025-08-01T16:01:39.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
15862025-08-01T16:01:39.766ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
15872025-08-01T16:01:39.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
15882025-08-01T16:01:39.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15892025-08-01T16:01:39.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15902025-08-01T16:01:39.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15912025-08-01T16:01:39.767ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
15922025-08-01T16:01:39.767ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.209788ms iteration = 47 status = {"chicken_switches_updated":false}
15932025-08-01T16:01:39.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15942025-08-01T16:01:39.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15952025-08-01T16:01:39.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15962025-08-01T16:01:39.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
15972025-08-01T16:01:39.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15982025-08-01T16:01:39.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15992025-08-01T16:01:39.786ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
16002025-08-01T16:01:39.786ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.71954ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
16012025-08-01T16:01:39.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 992 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 21510691-b7c2-4e9e-884f-d53ed993b39a response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
16022025-08-01T16:01:40.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = db4b54f4-4c56-4ae0-9bdb-e1531e649a43 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16032025-08-01T16:01:40.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = db4b54f4-4c56-4ae0-9bdb-e1531e649a43 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16042025-08-01T16:01:40.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2904 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = db4b54f4-4c56-4ae0-9bdb-e1531e649a43 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16052025-08-01T16:01:41.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 35aeaea9-11f3-46f1-a500-7d60e1c86186 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16062025-08-01T16:01:41.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 35aeaea9-11f3-46f1-a500-7d60e1c86186 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16072025-08-01T16:01:41.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2104 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 35aeaea9-11f3-46f1-a500-7d60e1c86186 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16082025-08-01T16:01:42.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f57f44c9-2323-4252-b3ce-142c91e3e17b roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16092025-08-01T16:01:42.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f57f44c9-2323-4252-b3ce-142c91e3e17b resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16102025-08-01T16:01:42.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2573 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f57f44c9-2323-4252-b3ce-142c91e3e17b response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16112025-08-01T16:01:43.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 648620ee-573d-4bec-95e2-8fa96e98a80a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16122025-08-01T16:01:43.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 648620ee-573d-4bec-95e2-8fa96e98a80a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16132025-08-01T16:01:43.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2604 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 648620ee-573d-4bec-95e2-8fa96e98a80a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16142025-08-01T16:01:44.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = baa6c276-366e-400e-bad1-22407708f7ea roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16152025-08-01T16:01:44.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = baa6c276-366e-400e-bad1-22407708f7ea resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16162025-08-01T16:01:44.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1917 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = baa6c276-366e-400e-bad1-22407708f7ea response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16172025-08-01T16:01:44.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 48 reason = Timeout
16182025-08-01T16:01:44.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
16192025-08-01T16:01:44.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
16202025-08-01T16:01:44.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16212025-08-01T16:01:44.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
16222025-08-01T16:01:44.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
16232025-08-01T16:01:44.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
16242025-08-01T16:01:44.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
16252025-08-01T16:01:44.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.163207ms iteration = 48 status = {"chicken_switches_updated":false}
16262025-08-01T16:01:44.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63991 req_id = a6258e35-8b5d-4938-8568-0d36491fba1a roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
16272025-08-01T16:01:44.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63991 req_id = a6258e35-8b5d-4938-8568-0d36491fba1a resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
16282025-08-01T16:01:44.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2012 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63991 req_id = a6258e35-8b5d-4938-8568-0d36491fba1a response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
16292025-08-01T16:01:44.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63991 req_id = 6fe5dfa1-e8b0-4509-af1b-8819a51956f3 roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
16302025-08-01T16:01:44.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63991 req_id = 6fe5dfa1-e8b0-4509-af1b-8819a51956f3 resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
16312025-08-01T16:01:44.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1961 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63991 req_id = 6fe5dfa1-e8b0-4509-af1b-8819a51956f3 response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
16322025-08-01T16:01:45.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 24d5342b-e1b1-43dc-865a-ead8edbb8587 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16332025-08-01T16:01:45.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 24d5342b-e1b1-43dc-865a-ead8edbb8587 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16342025-08-01T16:01:45.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2156 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 24d5342b-e1b1-43dc-865a-ead8edbb8587 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16352025-08-01T16:01:46.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 882d2fb4-d334-47a7-9c10-ab12c375c0b4 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16362025-08-01T16:01:46.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 882d2fb4-d334-47a7-9c10-ab12c375c0b4 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16372025-08-01T16:01:46.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2319 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 882d2fb4-d334-47a7-9c10-ab12c375c0b4 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16382025-08-01T16:01:47.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2b8ff2d8-b3cf-4f5c-929e-6935bfbce99e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16392025-08-01T16:01:47.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2b8ff2d8-b3cf-4f5c-929e-6935bfbce99e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16402025-08-01T16:01:47.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2299 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2b8ff2d8-b3cf-4f5c-929e-6935bfbce99e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16412025-08-01T16:01:48.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a323a25d-be54-4d4b-88f2-a76d61e13b86 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16422025-08-01T16:01:48.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a323a25d-be54-4d4b-88f2-a76d61e13b86 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16432025-08-01T16:01:48.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2558 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a323a25d-be54-4d4b-88f2-a76d61e13b86 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16442025-08-01T16:01:49.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cee524ae-6340-4bc3-9dae-e2dec3cf2d41 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16452025-08-01T16:01:49.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cee524ae-6340-4bc3-9dae-e2dec3cf2d41 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16462025-08-01T16:01:49.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2835 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cee524ae-6340-4bc3-9dae-e2dec3cf2d41 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
16472025-08-01T16:01:49.689ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
16482025-08-01T16:01:49.689ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
16492025-08-01T16:01:49.689ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
16502025-08-01T16:01:49.689ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16512025-08-01T16:01:49.689ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
16522025-08-01T16:01:49.689ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-01 15:51:49.689133139 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
16532025-08-01T16:01:49.689ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
16542025-08-01T16:01:49.689ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
16552025-08-01T16:01:49.689ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
16562025-08-01T16:01:49.689ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
16572025-08-01T16:01:49.689ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16582025-08-01T16:01:49.689ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
16592025-08-01T16:01:49.689ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
16602025-08-01T16:01:49.689ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16612025-08-01T16:01:49.689ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
16622025-08-01T16:01:49.689ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
16632025-08-01T16:01:49.689ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
16642025-08-01T16:01:49.689ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16652025-08-01T16:01:49.689ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
16662025-08-01T16:01:49.689ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
16672025-08-01T16:01:49.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16682025-08-01T16:01:49.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
16692025-08-01T16:01:49.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
16702025-08-01T16:01:49.689ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cb706a84-a33b-442f-aac2-3a6eb5f3b330.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d688a68d-d771-4ac5-8e66-9efa94dbbea8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d688a68d-d771-4ac5-8e66-9efa94dbbea8.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 43805, tv_nsec: 705204119 } })
16712025-08-01T16:01:49.689ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50fe31de-3241-42df-a386-de37ce323a34.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("58598327-8751-423c-a5ac-c610829651e2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 43805, tv_nsec: 705251480 } })
16722025-08-01T16:01:49.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16732025-08-01T16:01:49.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16742025-08-01T16:01:49.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16752025-08-01T16:01:49.690ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
16762025-08-01T16:01:49.690ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 958.069\u{b5}s iteration = 5 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
16772025-08-01T16:01:49.690ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
16782025-08-01T16:01:49.690ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.181016ms iteration = 5 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
16792025-08-01T16:01:49.690ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16802025-08-01T16:01:49.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16812025-08-01T16:01:49.692ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16822025-08-01T16:01:49.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16832025-08-01T16:01:49.692ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.63412ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
16842025-08-01T16:01:49.692ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-01 15:51:49.689133139 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
16852025-08-01T16:01:49.693ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16862025-08-01T16:01:49.693ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.862247ms iteration = 5 status = {"expiration":"2025-08-01T15:51:49.689133139Z","pruned":[]}
16872025-08-01T16:01:49.693ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43805, tv_nsec: 708713775 } })
16882025-08-01T16:01:49.693ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
16892025-08-01T16:01:49.694ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16902025-08-01T16:01:49.694ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16912025-08-01T16:01:49.694ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43805, tv_nsec: 710374735 } })
16922025-08-01T16:01:49.695ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
16932025-08-01T16:01:49.695ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
16942025-08-01T16:01:49.695ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16952025-08-01T16:01:49.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16962025-08-01T16:01:49.698ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16972025-08-01T16:01:49.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16982025-08-01T16:01:49.699ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16992025-08-01T16:01:49.700ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17002025-08-01T16:01:49.700ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
17012025-08-01T16:01:49.704ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
17022025-08-01T16:01:49.704ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17032025-08-01T16:01:49.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17042025-08-01T16:01:49.707ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
17052025-08-01T16:01:49.707ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1
17062025-08-01T16:01:49.707ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 24.1\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1"}
17072025-08-01T16:01:49.710ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 8 reason = Timeout
17082025-08-01T16:01:49.710ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
17092025-08-01T16:01:49.710ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 13.87\u{b5}s iteration = 8 status = "Disabled"
17102025-08-01T16:01:49.711ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 5 reason = Timeout
17112025-08-01T16:01:49.711ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
17122025-08-01T16:01:49.711ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
17132025-08-01T16:01:49.711ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
17142025-08-01T16:01:49.711ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
17152025-08-01T16:01:49.711ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 5 reason = Timeout
17162025-08-01T16:01:49.711ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
17172025-08-01T16:01:49.711ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
17182025-08-01T16:01:49.711ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
17192025-08-01T16:01:49.711ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
17202025-08-01T16:01:49.711ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
17212025-08-01T16:01:49.711ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
17222025-08-01T16:01:49.711ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
17232025-08-01T16:01:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
17242025-08-01T16:01:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
17252025-08-01T16:01:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
17262025-08-01T16:01:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
17272025-08-01T16:01:49.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
17282025-08-01T16:01:49.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
17292025-08-01T16:01:49.713ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
17302025-08-01T16:01:49.713ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 2.044662ms iteration = 5 status = {"by_rx":{},"error":null}
17312025-08-01T16:01:49.715ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.641061ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
17322025-08-01T16:01:49.715ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17332025-08-01T16:01:49.717ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
17342025-08-01T16:01:49.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
17352025-08-01T16:01:49.718ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
17362025-08-01T16:01:49.718ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
17372025-08-01T16:01:49.718ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 7.120855ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
17382025-08-01T16:01:49.719ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
17392025-08-01T16:01:49.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
17402025-08-01T16:01:49.719ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
17412025-08-01T16:01:49.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
17422025-08-01T16:01:49.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
17432025-08-01T16:01:49.723ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 12.113027ms iteration = 5 status = {"dispatched":[],"errors":[],"glob_version":"173.0.0","globs_reprocessed":{},"no_receivers":[]}
17442025-08-01T16:01:49.759ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 9 reason = Timeout
17452025-08-01T16:01:49.759ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 25.951\u{b5}s iteration = 9 status = {"disabled":true,"errors":[],"sps":[]}
17462025-08-01T16:01:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
17472025-08-01T16:01:49.759ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
17482025-08-01T16:01:49.759ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
17492025-08-01T16:01:49.759ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17502025-08-01T16:01:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17512025-08-01T16:01:49.759ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
17522025-08-01T16:01:49.759ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 9 reason = Timeout
17532025-08-01T16:01:49.759ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
17542025-08-01T16:01:49.759ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17552025-08-01T16:01:49.759ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
17562025-08-01T16:01:49.759ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17572025-08-01T16:01:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
17582025-08-01T16:01:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
17592025-08-01T16:01:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
17602025-08-01T16:01:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
17612025-08-01T16:01:49.759ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
17622025-08-01T16:01:49.759ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17632025-08-01T16:01:49.759ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
17642025-08-01T16:01:49.759ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
17652025-08-01T16:01:49.759ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17662025-08-01T16:01:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
17672025-08-01T16:01:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17682025-08-01T16:01:49.759ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
17692025-08-01T16:01:49.759ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
17702025-08-01T16:01:49.759ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17712025-08-01T16:01:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
17722025-08-01T16:01:49.759ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17732025-08-01T16:01:49.760ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17742025-08-01T16:01:49.760ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
17752025-08-01T16:01:49.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17762025-08-01T16:01:49.760ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 49 reason = Timeout
17772025-08-01T16:01:49.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
17782025-08-01T16:01:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17792025-08-01T16:01:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17802025-08-01T16:01:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17812025-08-01T16:01:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17822025-08-01T16:01:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
17832025-08-01T16:01:49.760ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
17842025-08-01T16:01:49.760ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 9 reason = Timeout
17852025-08-01T16:01:49.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17862025-08-01T16:01:49.760ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17872025-08-01T16:01:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
17882025-08-01T16:01:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
17892025-08-01T16:01:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17902025-08-01T16:01:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17912025-08-01T16:01:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
17922025-08-01T16:01:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17932025-08-01T16:01:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17942025-08-01T16:01:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17952025-08-01T16:01:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
17962025-08-01T16:01:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17972025-08-01T16:01:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17982025-08-01T16:01:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
17992025-08-01T16:01:49.763ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18002025-08-01T16:01:49.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18012025-08-01T16:01:49.763ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18022025-08-01T16:01:49.769ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18032025-08-01T16:01:49.769ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
18042025-08-01T16:01:49.769ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18052025-08-01T16:01:49.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18062025-08-01T16:01:49.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
18072025-08-01T16:01:49.770ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18082025-08-01T16:01:49.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18092025-08-01T16:01:49.770ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18102025-08-01T16:01:49.772ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18112025-08-01T16:01:49.772ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18122025-08-01T16:01:49.774ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18132025-08-01T16:01:49.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18142025-08-01T16:01:49.774ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18152025-08-01T16:01:49.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18162025-08-01T16:01:49.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18172025-08-01T16:01:49.775ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18182025-08-01T16:01:49.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18192025-08-01T16:01:49.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
18202025-08-01T16:01:49.777ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18212025-08-01T16:01:49.777ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18222025-08-01T16:01:49.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18232025-08-01T16:01:49.778ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18242025-08-01T16:01:49.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
18252025-08-01T16:01:49.778ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18262025-08-01T16:01:49.778ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
18272025-08-01T16:01:49.778ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
18282025-08-01T16:01:49.778ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
18292025-08-01T16:01:49.779ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18302025-08-01T16:01:49.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18312025-08-01T16:01:49.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18322025-08-01T16:01:49.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18332025-08-01T16:01:49.780ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
18342025-08-01T16:01:49.780ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
18352025-08-01T16:01:49.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
18362025-08-01T16:01:49.781ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18372025-08-01T16:01:49.782ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
18382025-08-01T16:01:49.782ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
18392025-08-01T16:01:49.782ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
18402025-08-01T16:01:49.782ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18412025-08-01T16:01:49.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18422025-08-01T16:01:49.782ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18432025-08-01T16:01:49.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
18442025-08-01T16:01:49.782ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
18452025-08-01T16:01:49.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18462025-08-01T16:01:49.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18472025-08-01T16:01:49.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
18482025-08-01T16:01:49.782ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18492025-08-01T16:01:49.782ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43805, tv_nsec: 798461116 } })
18502025-08-01T16:01:49.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18512025-08-01T16:01:49.782ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18522025-08-01T16:01:49.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18532025-08-01T16:01:49.783ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
18542025-08-01T16:01:49.784ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
18552025-08-01T16:01:49.784ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 24.683829ms iteration = 49 status = {"chicken_switches_updated":false}
18562025-08-01T16:01:49.784ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18572025-08-01T16:01:49.786ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
18582025-08-01T16:01:49.786ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18592025-08-01T16:01:49.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18602025-08-01T16:01:49.787ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
18612025-08-01T16:01:49.787ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 27.953687ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
18622025-08-01T16:01:49.787ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
18632025-08-01T16:01:49.788ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18642025-08-01T16:01:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
18652025-08-01T16:01:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18662025-08-01T16:01:49.789ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18672025-08-01T16:01:49.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18682025-08-01T16:01:49.790ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18692025-08-01T16:01:49.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18702025-08-01T16:01:49.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18712025-08-01T16:01:49.792ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
18722025-08-01T16:01:49.792ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
18732025-08-01T16:01:49.792ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 81.227012ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
18742025-08-01T16:01:49.793ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
18752025-08-01T16:01:49.793ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6482e44c-c860-4033-b945-5707d343a59d dns_zone_name = oxide.test found_so_far = 0 version = 2
18762025-08-01T16:01:49.793ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18772025-08-01T16:01:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18782025-08-01T16:01:49.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
18792025-08-01T16:01:49.794ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
18802025-08-01T16:01:49.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
18812025-08-01T16:01:49.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18822025-08-01T16:01:49.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
18832025-08-01T16:01:49.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18842025-08-01T16:01:49.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18852025-08-01T16:01:49.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18862025-08-01T16:01:49.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18872025-08-01T16:01:49.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18882025-08-01T16:01:49.803ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6482e44c-c860-4033-b945-5707d343a59d dns_zone_name = oxide.test found_so_far = 4 version = 2
18892025-08-01T16:01:49.803ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
18902025-08-01T16:01:49.803ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-01 15:58:34.713515 UTC dns_group = external generation = 2
18912025-08-01T16:01:49.803ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 114.731328ms iteration = 5 status = {"generation":2}
18922025-08-01T16:01:49.819ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
18932025-08-01T16:01:49.837ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
18942025-08-01T16:01:49.837ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 76.972334ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
18952025-08-01T16:01:49.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18962025-08-01T16:01:49.839ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 79.48425ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
18972025-08-01T16:01:49.841ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
18982025-08-01T16:01:49.841ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18992025-08-01T16:01:49.841ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb859d0b-4993-4cf0-9d2a-3000c0c10614", "content-length": "26", "date": "Fri, 01 Aug 2025 16:01:49 GMT"} })
19002025-08-01T16:01:49.841ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19012025-08-01T16:01:49.843ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19022025-08-01T16:01:49.843ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19032025-08-01T16:01:49.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19042025-08-01T16:01:49.843ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19052025-08-01T16:01:49.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19062025-08-01T16:01:49.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19072025-08-01T16:01:49.845ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 85.328777ms iteration = 9 status = {"errors":[],"finish_invoked_ok":[]}
19082025-08-01T16:01:49.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19092025-08-01T16:01:49.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19102025-08-01T16:01:49.848ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19112025-08-01T16:01:49.849ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
19122025-08-01T16:01:49.852ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19132025-08-01T16:01:49.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19142025-08-01T16:01:49.852ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19152025-08-01T16:01:49.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19162025-08-01T16:01:49.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19172025-08-01T16:01:49.853ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 93.493355ms iteration = 9 status = {"errors":[],"requests_created_ok":[]}
19182025-08-01T16:01:49.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19192025-08-01T16:01:49.855ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 95.541457ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19202025-08-01T16:01:49.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19212025-08-01T16:01:49.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19222025-08-01T16:01:49.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19232025-08-01T16:01:49.857ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19242025-08-01T16:01:49.857ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 97.878508ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
19252025-08-01T16:01:49.859ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
19262025-08-01T16:01:49.859ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 02fcb774-aa43-4052-9996-b85e2d1358b5 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
19272025-08-01T16:01:49.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19282025-08-01T16:01:49.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19292025-08-01T16:01:49.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19302025-08-01T16:01:49.860ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19312025-08-01T16:01:49.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19322025-08-01T16:01:49.861ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-01T15:57:44.766264Z, time_modified: 2025-08-01T15:57:44.766264Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: eec17da7-eb17-4917-8728-908698b69bbe, db_silo: Silo { identity: SiloIdentity { id: eec17da7-eb17-4917-8728-908698b69bbe, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-01T15:58:34.653875Z, time_modified: 2025-08-01T15:58:34.653875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: eec17da7-eb17-4917-8728-908698b69bbe, db_silo: Silo { identity: SiloIdentity { id: eec17da7-eb17-4917-8728-908698b69bbe, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-01T15:58:34.653875Z, time_modified: 2025-08-01T15:58:34.653875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575" }] }) }
19332025-08-01T16:01:49.861ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 172.376626ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"eec17da7-eb17-4917-8728-908698b69bbe","tls_certs":["b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575"]}},"default_endpoint":{"silo_id":"eec17da7-eb17-4917-8728-908698b69bbe","tls_certs":["b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
19342025-08-01T16:01:49.863ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19352025-08-01T16:01:49.863ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19362025-08-01T16:01:49.863ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
19372025-08-01T16:01:49.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19382025-08-01T16:01:49.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19392025-08-01T16:01:49.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19402025-08-01T16:01:49.867ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19412025-08-01T16:01:49.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19422025-08-01T16:01:49.871ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 02fcb774-aa43-4052-9996-b85e2d1358b5 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
19432025-08-01T16:01:49.871ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
19442025-08-01T16:01:49.871ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-01 15:58:34.032744 UTC dns_group = internal generation = 1
19452025-08-01T16:01:49.871ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 182.783512ms iteration = 5 status = {"generation":1}
19462025-08-01T16:01:49.876ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:391
19472025-08-01T16:01:49.876ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 116.584155ms iteration = 9 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
19482025-08-01T16:01:49.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19492025-08-01T16:01:49.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19502025-08-01T16:01:49.883ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19512025-08-01T16:01:49.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19522025-08-01T16:01:49.885ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19532025-08-01T16:01:49.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
19542025-08-01T16:01:49.891ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19552025-08-01T16:01:49.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19562025-08-01T16:01:49.894ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 134.131607ms iteration = 9 status = 0
19572025-08-01T16:01:49.897ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 137.973044ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19582025-08-01T16:01:49.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 146.400239ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19592025-08-01T16:01:49.910ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19602025-08-01T16:01:49.910ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
19612025-08-01T16:01:49.910ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 150.847584ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
19622025-08-01T16:01:49.921ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 161.445085ms iteration = 11 status = {"physical_disks_added":0}
19632025-08-01T16:01:49.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 756 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 00d1e566-a9a8-40b5-9efd-a6b2bc4d4a57 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
19642025-08-01T16:01:49.925ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 zone_address = fd00:1122:3344:101::2
19652025-08-01T16:01:49.925ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19662025-08-01T16:01:49.925ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f46427e-912c-4d7e-b599-0bb968457581", "content-length": "26", "date": "Fri, 01 Aug 2025 16:01:49 GMT"} })
19672025-08-01T16:01:49.925ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19682025-08-01T16:01:49.926ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
19692025-08-01T16:01:49.950ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19702025-08-01T16:01:49.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19712025-08-01T16:01:49.985ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
19722025-08-01T16:01:49.993ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
19732025-08-01T16:01:49.993ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 282.459195ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
19742025-08-01T16:01:50.076ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19752025-08-01T16:01:50.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19762025-08-01T16:01:50.077ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19772025-08-01T16:01:50.080ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19782025-08-01T16:01:50.080ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19792025-08-01T16:01:50.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19802025-08-01T16:01:50.082ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19812025-08-01T16:01:50.084ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19822025-08-01T16:01:50.084ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19832025-08-01T16:01:50.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19842025-08-01T16:01:50.193ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
19852025-08-01T16:01:50.193ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "942b8554-8ff7-4cdb-b1d5-41c8c1c235f9", "date": "Fri, 01 Aug 2025 16:01:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
19862025-08-01T16:01:50.193ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
19872025-08-01T16:01:50.195ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "67171762-5a2f-4694-af23-3f499b08bfd9", "date": "Fri, 01 Aug 2025 16:01:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
19882025-08-01T16:01:50.195ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
19892025-08-01T16:01:50.197ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b35dc732-a0a1-4731-96aa-1250b8d52f66", "date": "Fri, 01 Aug 2025 16:01:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
19902025-08-01T16:01:50.197ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
19912025-08-01T16:01:50.199ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
19922025-08-01T16:01:50.199ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 509.810218ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
19932025-08-01T16:01:50.223ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
19942025-08-01T16:01:50.223ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19952025-08-01T16:01:50.223ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "503720d1-6a55-4613-86c3-c10d2945317b", "content-length": "26", "date": "Fri, 01 Aug 2025 16:01:49 GMT"} })
19962025-08-01T16:01:50.223ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19972025-08-01T16:01:50.225ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19982025-08-01T16:01:50.246ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19992025-08-01T16:01:50.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20002025-08-01T16:01:50.249ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 559.878277ms iteration = 9 status = null
20012025-08-01T16:01:50.271ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
20022025-08-01T16:01:50.272ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb9ad3bb-e424-4253-a562-c3e52e1f1fb1", "content-length": "691", "date": "Fri, 01 Aug 2025 16:01:49 GMT"} })
20032025-08-01T16:01:50.272ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
20042025-08-01T16:01:50.272ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
20052025-08-01T16:01:50.272ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
20062025-08-01T16:01:50.274ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 515.078598ms iteration = 9 status = {}
20072025-08-01T16:01:50.300ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
20082025-08-01T16:01:50.301ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "c2b842b2-7eb4-411f-94c8-e8129bf52048", "date": "Fri, 01 Aug 2025 16:01:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
20092025-08-01T16:01:50.301ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
20102025-08-01T16:01:50.303ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "8a76fbf6-c3da-45da-8d28-1ad5c24452b2", "date": "Fri, 01 Aug 2025 16:01:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
20112025-08-01T16:01:50.303ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
20122025-08-01T16:01:50.305ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
20132025-08-01T16:01:50.305ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 616.125702ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
20142025-08-01T16:01:50.318ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
20152025-08-01T16:01:50.318ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20162025-08-01T16:01:50.323ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1bc098ef-99bb-4f05-8fff-3998cc5eb3ea", "content-length": "372", "date": "Fri, 01 Aug 2025 16:01:49 GMT"} })
20172025-08-01T16:01:50.323ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20182025-08-01T16:01:50.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20192025-08-01T16:01:50.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2005c7e5-8630-4a33-b0b5-1fe2b3635d92 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
20202025-08-01T16:01:50.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2005c7e5-8630-4a33-b0b5-1fe2b3635d92 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
20212025-08-01T16:01:50.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2383 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2005c7e5-8630-4a33-b0b5-1fe2b3635d92 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
20222025-08-01T16:01:50.330ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 641.022066ms iteration = 9 status = {}
20232025-08-01T16:01:50.337ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20242025-08-01T16:01:50.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20252025-08-01T16:01:50.339ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 3f21d9d5-3adf-463a-a05d-bc2e2e5d64ca, rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(4c7da70d-ede0-4107-abc5-5650a053be38) } rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
20262025-08-01T16:01:50.339ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20272025-08-01T16:01:50.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20282025-08-01T16:01:50.341ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
20292025-08-01T16:01:50.341ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
20302025-08-01T16:01:50.341ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a0390974-3ed2-43f3-9184-ef1c064ed6d9", "date": "Fri, 01 Aug 2025 16:01:50 GMT"} })
20312025-08-01T16:01:50.341ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20322025-08-01T16:01:50.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20332025-08-01T16:01:50.344ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20342025-08-01T16:01:50.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20352025-08-01T16:01:50.348ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
20362025-08-01T16:01:50.348ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 4c7da70d-ede0-4107-abc5-5650a053be38
20372025-08-01T16:01:50.348ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20382025-08-01T16:01:50.348ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
20392025-08-01T16:01:50.348ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
20402025-08-01T16:01:50.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20412025-08-01T16:01:50.348ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20422025-08-01T16:01:50.348ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20432025-08-01T16:01:50.348ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20442025-08-01T16:01:50.348ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20452025-08-01T16:01:50.348ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20462025-08-01T16:01:50.348ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20472025-08-01T16:01:50.348ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
20482025-08-01T16:01:50.348ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20492025-08-01T16:01:50.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20502025-08-01T16:01:50.351ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
20512025-08-01T16:01:50.351ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
20522025-08-01T16:01:50.351ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
20532025-08-01T16:01:50.351ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20542025-08-01T16:01:50.358ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "de85005b-ce37-44ee-8f88-43dc64e52aa9", "date": "Fri, 01 Aug 2025 16:01:49 GMT"} })
20552025-08-01T16:01:50.360ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 601.085765ms iteration = 9 status = {}
20562025-08-01T16:01:50.466ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "94bb4175-26fe-4e13-9eaf-99c27c7f0a21", "date": "Fri, 01 Aug 2025 16:01:50 GMT"} })
20572025-08-01T16:01:50.466ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch = Switch0
20582025-08-01T16:01:50.466ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
20592025-08-01T16:01:50.467ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "534900d2-4960-4f1c-b98f-ab4c464193d3", "content-length": "682", "date": "Fri, 01 Aug 2025 16:01:50 GMT"} })
20602025-08-01T16:01:50.467ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20612025-08-01T16:01:50.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20622025-08-01T16:01:50.470ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20632025-08-01T16:01:50.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20642025-08-01T16:01:50.475ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20652025-08-01T16:01:50.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20662025-08-01T16:01:50.477ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20672025-08-01T16:01:50.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20682025-08-01T16:01:50.483ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 724.105456ms iteration = 9 status = {}
20692025-08-01T16:01:51.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fb021f6b-697b-4206-a0ed-e0c1c8fe404f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
20702025-08-01T16:01:51.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fb021f6b-697b-4206-a0ed-e0c1c8fe404f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
20712025-08-01T16:01:51.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2136 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fb021f6b-697b-4206-a0ed-e0c1c8fe404f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
20722025-08-01T16:01:52.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cbc2c4a8-cf2c-4848-a1f4-11cc8634beb8 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
20732025-08-01T16:01:52.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cbc2c4a8-cf2c-4848-a1f4-11cc8634beb8 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
20742025-08-01T16:01:52.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2234 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cbc2c4a8-cf2c-4848-a1f4-11cc8634beb8 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
20752025-08-01T16:01:53.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 36755e7f-4cef-4a30-8938-79b9f19b8821 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
20762025-08-01T16:01:53.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 36755e7f-4cef-4a30-8938-79b9f19b8821 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
20772025-08-01T16:01:53.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2161 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 36755e7f-4cef-4a30-8938-79b9f19b8821 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
20782025-08-01T16:01:54.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5fb87af5-008c-4bbb-9318-5c46bcb736ef roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
20792025-08-01T16:01:54.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5fb87af5-008c-4bbb-9318-5c46bcb736ef resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
20802025-08-01T16:01:54.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2450 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5fb87af5-008c-4bbb-9318-5c46bcb736ef response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
20812025-08-01T16:01:54.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 50 reason = Timeout
20822025-08-01T16:01:54.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
20832025-08-01T16:01:54.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
20842025-08-01T16:01:54.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20852025-08-01T16:01:54.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
20862025-08-01T16:01:54.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
20872025-08-01T16:01:54.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
20882025-08-01T16:01:54.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
20892025-08-01T16:01:54.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.180347ms iteration = 50 status = {"chicken_switches_updated":false}
20902025-08-01T16:01:55.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b5786cb8-52d8-4730-9d41-f756b3c71679 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
20912025-08-01T16:01:55.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b5786cb8-52d8-4730-9d41-f756b3c71679 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
20922025-08-01T16:01:55.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2176 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b5786cb8-52d8-4730-9d41-f756b3c71679 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
20932025-08-01T16:01:56.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c3170647-262f-4df9-b25e-106e6ea70247 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
20942025-08-01T16:01:56.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c3170647-262f-4df9-b25e-106e6ea70247 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
20952025-08-01T16:01:56.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2087 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c3170647-262f-4df9-b25e-106e6ea70247 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
20962025-08-01T16:01:57.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9dd85d71-ab98-4d1e-a783-2cc172ad67ff roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
20972025-08-01T16:01:57.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9dd85d71-ab98-4d1e-a783-2cc172ad67ff resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
20982025-08-01T16:01:57.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2232 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9dd85d71-ab98-4d1e-a783-2cc172ad67ff response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
20992025-08-01T16:01:58.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cd32e13d-b488-49fc-8882-1c32de7bc374 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21002025-08-01T16:01:58.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cd32e13d-b488-49fc-8882-1c32de7bc374 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21012025-08-01T16:01:58.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3012 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cd32e13d-b488-49fc-8882-1c32de7bc374 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21022025-08-01T16:01:59.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 306a141d-7852-4593-a5f5-1a4d288679eb roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21032025-08-01T16:01:59.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 306a141d-7852-4593-a5f5-1a4d288679eb resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21042025-08-01T16:01:59.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2017 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 306a141d-7852-4593-a5f5-1a4d288679eb response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21052025-08-01T16:01:59.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
21062025-08-01T16:01:59.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 51 reason = Timeout
21072025-08-01T16:01:59.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21082025-08-01T16:01:59.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
21092025-08-01T16:01:59.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
21102025-08-01T16:01:59.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21112025-08-01T16:01:59.760ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
21122025-08-01T16:01:59.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21132025-08-01T16:01:59.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21142025-08-01T16:01:59.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21152025-08-01T16:01:59.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21162025-08-01T16:01:59.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21172025-08-01T16:01:59.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21182025-08-01T16:01:59.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
21192025-08-01T16:01:59.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
21202025-08-01T16:01:59.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
21212025-08-01T16:01:59.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21222025-08-01T16:01:59.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21232025-08-01T16:01:59.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21242025-08-01T16:01:59.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
21252025-08-01T16:01:59.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.959591ms iteration = 51 status = {"chicken_switches_updated":false}
21262025-08-01T16:01:59.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21272025-08-01T16:01:59.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21282025-08-01T16:01:59.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21292025-08-01T16:01:59.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
21302025-08-01T16:01:59.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21312025-08-01T16:01:59.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21322025-08-01T16:01:59.791ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
21332025-08-01T16:01:59.791ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.949148ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
21342025-08-01T16:01:59.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 43.20558ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21352025-08-01T16:01:59.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 489 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 8c56d8e8-acde-42bd-9bcc-354cd09fd322 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
21362025-08-01T16:02:00.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8046f75f-0cab-42af-ab7c-96739bff2f65 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21372025-08-01T16:02:00.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8046f75f-0cab-42af-ab7c-96739bff2f65 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21382025-08-01T16:02:00.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2243 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8046f75f-0cab-42af-ab7c-96739bff2f65 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21392025-08-01T16:02:01.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 993a3a10-44ef-43ea-a825-5276eaf2179d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21402025-08-01T16:02:01.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 993a3a10-44ef-43ea-a825-5276eaf2179d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21412025-08-01T16:02:01.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2182 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 993a3a10-44ef-43ea-a825-5276eaf2179d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21422025-08-01T16:02:02.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4ec32649-e58b-41db-ac16-291b11e80c63 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21432025-08-01T16:02:02.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4ec32649-e58b-41db-ac16-291b11e80c63 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21442025-08-01T16:02:02.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2479 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4ec32649-e58b-41db-ac16-291b11e80c63 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21452025-08-01T16:02:03.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7d130f86-fac2-48a4-b368-6bc3a8412f99 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21462025-08-01T16:02:03.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7d130f86-fac2-48a4-b368-6bc3a8412f99 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21472025-08-01T16:02:03.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1685 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7d130f86-fac2-48a4-b368-6bc3a8412f99 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21482025-08-01T16:02:04.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2ef06a46-7975-4ab1-a7e1-368b98f04ad9 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21492025-08-01T16:02:04.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2ef06a46-7975-4ab1-a7e1-368b98f04ad9 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21502025-08-01T16:02:04.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2027 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2ef06a46-7975-4ab1-a7e1-368b98f04ad9 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21512025-08-01T16:02:04.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 52 reason = Timeout
21522025-08-01T16:02:04.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
21532025-08-01T16:02:04.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
21542025-08-01T16:02:04.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21552025-08-01T16:02:04.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
21562025-08-01T16:02:04.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
21572025-08-01T16:02:04.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
21582025-08-01T16:02:04.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
21592025-08-01T16:02:04.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.957411ms iteration = 52 status = {"chicken_switches_updated":false}
21602025-08-01T16:02:05.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f64a48d8-ecfa-41fe-ae74-664b2e681255 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21612025-08-01T16:02:05.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f64a48d8-ecfa-41fe-ae74-664b2e681255 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21622025-08-01T16:02:05.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2414 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f64a48d8-ecfa-41fe-ae74-664b2e681255 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21632025-08-01T16:02:06.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 01016c8d-6558-4537-898a-6d76fd82efe7 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21642025-08-01T16:02:06.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 01016c8d-6558-4537-898a-6d76fd82efe7 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21652025-08-01T16:02:06.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1944 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 01016c8d-6558-4537-898a-6d76fd82efe7 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21662025-08-01T16:02:07.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ecddf3a7-ab77-4276-90f3-3f4582bee204 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21672025-08-01T16:02:07.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ecddf3a7-ab77-4276-90f3-3f4582bee204 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21682025-08-01T16:02:07.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2222 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ecddf3a7-ab77-4276-90f3-3f4582bee204 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21692025-08-01T16:02:08.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 680cdeee-59b6-4526-a773-5eb72453cf87 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21702025-08-01T16:02:08.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 680cdeee-59b6-4526-a773-5eb72453cf87 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21712025-08-01T16:02:08.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2119 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 680cdeee-59b6-4526-a773-5eb72453cf87 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21722025-08-01T16:02:09.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d4754f10-d78c-4d77-88bc-4f5375c0c649 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21732025-08-01T16:02:09.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d4754f10-d78c-4d77-88bc-4f5375c0c649 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21742025-08-01T16:02:09.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2300 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d4754f10-d78c-4d77-88bc-4f5375c0c649 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
21752025-08-01T16:02:09.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
21762025-08-01T16:02:09.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 53 reason = Timeout
21772025-08-01T16:02:09.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21782025-08-01T16:02:09.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
21792025-08-01T16:02:09.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
21802025-08-01T16:02:09.760ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
21812025-08-01T16:02:09.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21822025-08-01T16:02:09.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21832025-08-01T16:02:09.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21842025-08-01T16:02:09.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21852025-08-01T16:02:09.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21862025-08-01T16:02:09.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21872025-08-01T16:02:09.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21882025-08-01T16:02:09.763ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.140046ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21892025-08-01T16:02:09.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
21902025-08-01T16:02:09.765ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
21912025-08-01T16:02:09.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
21922025-08-01T16:02:09.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21932025-08-01T16:02:09.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21942025-08-01T16:02:09.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21952025-08-01T16:02:09.767ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
21962025-08-01T16:02:09.767ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.026463ms iteration = 53 status = {"chicken_switches_updated":false}
21972025-08-01T16:02:09.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21982025-08-01T16:02:09.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21992025-08-01T16:02:09.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22002025-08-01T16:02:09.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
22012025-08-01T16:02:09.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22022025-08-01T16:02:09.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22032025-08-01T16:02:09.784ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
22042025-08-01T16:02:09.784ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.017388ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
22052025-08-01T16:02:09.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 523 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 5bb775ef-5d6d-4106-8aa5-0293e530d901 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
22062025-08-01T16:02:10.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f4a21381-25c9-40fa-be61-3277560a50ce roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
22072025-08-01T16:02:10.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f4a21381-25c9-40fa-be61-3277560a50ce resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
22082025-08-01T16:02:10.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2387 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f4a21381-25c9-40fa-be61-3277560a50ce response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
22092025-08-01T16:02:11.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6eccfc40-2cb0-4750-9ea6-71208f6c11c0 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
22102025-08-01T16:02:11.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6eccfc40-2cb0-4750-9ea6-71208f6c11c0 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
22112025-08-01T16:02:11.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2252 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6eccfc40-2cb0-4750-9ea6-71208f6c11c0 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
22122025-08-01T16:02:12.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 66cdf759-a871-4952-96d5-57656d421b8f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
22132025-08-01T16:02:12.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 66cdf759-a871-4952-96d5-57656d421b8f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
22142025-08-01T16:02:12.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2330 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 66cdf759-a871-4952-96d5-57656d421b8f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
22152025-08-01T16:02:13.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9d7bff57-e192-48b5-aad0-b986f2863ae8 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
22162025-08-01T16:02:13.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9d7bff57-e192-48b5-aad0-b986f2863ae8 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
22172025-08-01T16:02:13.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2099 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9d7bff57-e192-48b5-aad0-b986f2863ae8 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
22182025-08-01T16:02:14.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 718abdf2-02f3-43aa-81fc-93f53e5e6374 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
22192025-08-01T16:02:14.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 718abdf2-02f3-43aa-81fc-93f53e5e6374 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
22202025-08-01T16:02:14.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2590 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 718abdf2-02f3-43aa-81fc-93f53e5e6374 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
22212025-08-01T16:02:14.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 54 reason = Timeout
22222025-08-01T16:02:14.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
22232025-08-01T16:02:14.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
22242025-08-01T16:02:14.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22252025-08-01T16:02:14.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
22262025-08-01T16:02:14.765ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
22272025-08-01T16:02:14.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
22282025-08-01T16:02:14.767ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
22292025-08-01T16:02:14.767ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.575069ms iteration = 54 status = {"chicken_switches_updated":false}
22302025-08-01T16:02:15.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 14ca3e85-9d34-411d-8a57-d436b8e4cfe4 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
22312025-08-01T16:02:15.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 14ca3e85-9d34-411d-8a57-d436b8e4cfe4 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
22322025-08-01T16:02:15.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2683 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 14ca3e85-9d34-411d-8a57-d436b8e4cfe4 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
22332025-08-01T16:02:16.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 76e65fdf-5246-4cc0-a551-123dc077d0d8 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
22342025-08-01T16:02:16.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 76e65fdf-5246-4cc0-a551-123dc077d0d8 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
22352025-08-01T16:02:16.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2309 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 76e65fdf-5246-4cc0-a551-123dc077d0d8 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
22362025-08-01T16:02:17.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d3c4c6f1-4fbc-45d4-95c0-89bdc7f97d54 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
22372025-08-01T16:02:17.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d3c4c6f1-4fbc-45d4-95c0-89bdc7f97d54 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
22382025-08-01T16:02:17.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2051 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d3c4c6f1-4fbc-45d4-95c0-89bdc7f97d54 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
22392025-08-01T16:02:18.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 903d2422-e832-4f37-9a8f-b7484d391c47 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
22402025-08-01T16:02:18.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 903d2422-e832-4f37-9a8f-b7484d391c47 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
22412025-08-01T16:02:18.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2311 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 903d2422-e832-4f37-9a8f-b7484d391c47 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
22422025-08-01T16:02:19.688ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
22432025-08-01T16:02:19.688ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
22442025-08-01T16:02:19.688ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
22452025-08-01T16:02:19.688ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
22462025-08-01T16:02:19.688ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22472025-08-01T16:02:19.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
22482025-08-01T16:02:19.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22492025-08-01T16:02:19.691ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43835, tv_nsec: 707757849 } })
22502025-08-01T16:02:19.692ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43835, tv_nsec: 707870973 } })
22512025-08-01T16:02:19.692ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
22522025-08-01T16:02:19.693ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.997622ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
22532025-08-01T16:02:19.693ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
22542025-08-01T16:02:19.759ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
22552025-08-01T16:02:19.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
22562025-08-01T16:02:19.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
22572025-08-01T16:02:19.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
22582025-08-01T16:02:19.759ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22592025-08-01T16:02:19.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
22602025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
22612025-08-01T16:02:19.760ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
22622025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
22632025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
22642025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22652025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
22662025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22672025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22682025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22692025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
22702025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
22712025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
22722025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
22732025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22742025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 10 reason = Timeout
22752025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 14.761\u{b5}s iteration = 10 status = {"disabled":true,"errors":[],"sps":[]}
22762025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 55 reason = Timeout
22772025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
22782025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22792025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
22802025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
22812025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22822025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
22832025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22842025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
22852025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22862025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 10 reason = Timeout
22872025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
22882025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 10 reason = Timeout
22892025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
22902025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
22912025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22922025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
22932025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22942025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
22952025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
22962025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22972025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
22982025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22992025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23002025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23012025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23022025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23032025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
23042025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23052025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23062025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23072025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23082025-08-01T16:02:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
23092025-08-01T16:02:19.762ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23102025-08-01T16:02:19.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23112025-08-01T16:02:19.765ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23122025-08-01T16:02:19.765ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 5.719064ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
23132025-08-01T16:02:19.765ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23142025-08-01T16:02:19.766ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23152025-08-01T16:02:19.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23162025-08-01T16:02:19.767ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23172025-08-01T16:02:19.767ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23182025-08-01T16:02:19.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23192025-08-01T16:02:19.768ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23202025-08-01T16:02:19.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
23212025-08-01T16:02:19.769ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23222025-08-01T16:02:19.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23232025-08-01T16:02:19.770ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23242025-08-01T16:02:19.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23252025-08-01T16:02:19.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
23262025-08-01T16:02:19.770ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23272025-08-01T16:02:19.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23282025-08-01T16:02:19.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23292025-08-01T16:02:19.771ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23302025-08-01T16:02:19.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
23312025-08-01T16:02:19.771ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
23322025-08-01T16:02:19.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23332025-08-01T16:02:19.772ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23342025-08-01T16:02:19.772ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 12.21598ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23352025-08-01T16:02:19.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
23362025-08-01T16:02:19.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
23372025-08-01T16:02:19.772ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23382025-08-01T16:02:19.772ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 12.560711ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23392025-08-01T16:02:19.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23402025-08-01T16:02:19.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23412025-08-01T16:02:19.773ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
23422025-08-01T16:02:19.773ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23432025-08-01T16:02:19.773ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23442025-08-01T16:02:19.773ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23452025-08-01T16:02:19.773ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "15a3546c-2393-44ed-9e2c-63985659005c", "content-length": "26", "date": "Fri, 01 Aug 2025 16:02:19 GMT"} })
23462025-08-01T16:02:19.773ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23472025-08-01T16:02:19.773ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23482025-08-01T16:02:19.773ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23492025-08-01T16:02:19.774ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 13.925422ms iteration = 10 status = {"errors":[],"requests_created_ok":[]}
23502025-08-01T16:02:19.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23512025-08-01T16:02:19.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23522025-08-01T16:02:19.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23532025-08-01T16:02:19.775ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
23542025-08-01T16:02:19.775ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 15.275413ms iteration = 55 status = {"chicken_switches_updated":false}
23552025-08-01T16:02:19.775ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23562025-08-01T16:02:19.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23572025-08-01T16:02:19.775ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43835, tv_nsec: 791701354 } })
23582025-08-01T16:02:19.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
23592025-08-01T16:02:19.776ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
23602025-08-01T16:02:19.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
23612025-08-01T16:02:19.776ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
23622025-08-01T16:02:19.776ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23632025-08-01T16:02:19.776ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23642025-08-01T16:02:19.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23652025-08-01T16:02:19.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23662025-08-01T16:02:19.777ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23672025-08-01T16:02:19.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23682025-08-01T16:02:19.778ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23692025-08-01T16:02:19.779ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23702025-08-01T16:02:19.781ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23712025-08-01T16:02:19.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23722025-08-01T16:02:19.782ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23732025-08-01T16:02:19.782ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23742025-08-01T16:02:19.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23752025-08-01T16:02:19.784ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23762025-08-01T16:02:19.784ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23772025-08-01T16:02:19.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23782025-08-01T16:02:19.786ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23792025-08-01T16:02:19.787ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23802025-08-01T16:02:19.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23812025-08-01T16:02:19.789ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
23822025-08-01T16:02:19.789ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23832025-08-01T16:02:19.790ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "57ae791d-03c9-4f67-995b-2c8ae88374a6", "content-length": "26", "date": "Fri, 01 Aug 2025 16:02:19 GMT"} })
23842025-08-01T16:02:19.790ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23852025-08-01T16:02:19.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
23862025-08-01T16:02:19.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23872025-08-01T16:02:19.791ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
23882025-08-01T16:02:19.791ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 31.537156ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
23892025-08-01T16:02:19.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23902025-08-01T16:02:19.793ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23912025-08-01T16:02:19.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 004ea9b3-bd3f-45c6-a1b0-8d96fac47ce1 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
23922025-08-01T16:02:19.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 004ea9b3-bd3f-45c6-a1b0-8d96fac47ce1 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
23932025-08-01T16:02:19.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3367 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 004ea9b3-bd3f-45c6-a1b0-8d96fac47ce1 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
23942025-08-01T16:02:19.803ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23952025-08-01T16:02:19.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23962025-08-01T16:02:19.821ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
23972025-08-01T16:02:19.821ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 60.939968ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
23982025-08-01T16:02:19.830ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 70.692673ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
23992025-08-01T16:02:19.833ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 74.033125ms iteration = 10 status = {"errors":[],"finish_invoked_ok":[]}
24002025-08-01T16:02:19.835ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
24012025-08-01T16:02:19.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
24022025-08-01T16:02:19.836ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24032025-08-01T16:02:19.836ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
24042025-08-01T16:02:19.836ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24052025-08-01T16:02:19.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24062025-08-01T16:02:19.839ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24072025-08-01T16:02:19.839ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
24082025-08-01T16:02:19.839ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24092025-08-01T16:02:19.840ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24102025-08-01T16:02:19.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24112025-08-01T16:02:19.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24122025-08-01T16:02:19.841ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 81.097999ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
24132025-08-01T16:02:19.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24142025-08-01T16:02:19.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24152025-08-01T16:02:19.844ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 zone_address = fd00:1122:3344:101::2
24162025-08-01T16:02:19.844ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24172025-08-01T16:02:19.845ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "76047f71-3790-4b80-946e-f604efa66c56", "content-length": "26", "date": "Fri, 01 Aug 2025 16:02:19 GMT"} })
24182025-08-01T16:02:19.845ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24192025-08-01T16:02:19.845ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24202025-08-01T16:02:19.847ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 159.251869ms iteration = 10 status = {}
24212025-08-01T16:02:19.847ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
24222025-08-01T16:02:19.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
24232025-08-01T16:02:19.849ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24242025-08-01T16:02:19.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24252025-08-01T16:02:19.852ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 92.083782ms iteration = 10 status = 0
24262025-08-01T16:02:19.857ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24272025-08-01T16:02:19.859ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24282025-08-01T16:02:19.859ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24292025-08-01T16:02:19.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24302025-08-01T16:02:19.861ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24312025-08-01T16:02:19.866ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24322025-08-01T16:02:19.866ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24332025-08-01T16:02:19.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24342025-08-01T16:02:19.885ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24352025-08-01T16:02:19.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24362025-08-01T16:02:19.886ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24372025-08-01T16:02:19.888ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 199.636963ms iteration = 10 status = null
24382025-08-01T16:02:19.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
24392025-08-01T16:02:19.888ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
24402025-08-01T16:02:19.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
24412025-08-01T16:02:19.889ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24422025-08-01T16:02:19.889ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
24432025-08-01T16:02:19.889ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 129.538688ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
24442025-08-01T16:02:19.890ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:391
24452025-08-01T16:02:19.890ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 130.832457ms iteration = 10 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
24462025-08-01T16:02:19.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 744 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = c82a0dc1-9836-4df6-bc87-43e6a11f02cc response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
24472025-08-01T16:02:19.946ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 186.819025ms iteration = 12 status = {"physical_disks_added":0}
24482025-08-01T16:02:19.959ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
24492025-08-01T16:02:19.959ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "61966dca-422a-436f-9383-baf8c7d3c922", "content-length": "691", "date": "Fri, 01 Aug 2025 16:02:19 GMT"} })
24502025-08-01T16:02:19.959ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
24512025-08-01T16:02:19.959ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
24522025-08-01T16:02:19.959ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
24532025-08-01T16:02:19.960ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 200.83634ms iteration = 10 status = {}
24542025-08-01T16:02:19.986ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
24552025-08-01T16:02:19.986ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24562025-08-01T16:02:19.987ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec7481b5-91b4-4c39-8510-9f241d271042", "content-length": "372", "date": "Fri, 01 Aug 2025 16:02:19 GMT"} })
24572025-08-01T16:02:19.987ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24582025-08-01T16:02:19.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24592025-08-01T16:02:20.038ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24602025-08-01T16:02:20.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24612025-08-01T16:02:20.041ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 3f21d9d5-3adf-463a-a05d-bc2e2e5d64ca, rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(4c7da70d-ede0-4107-abc5-5650a053be38) } rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
24622025-08-01T16:02:20.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24632025-08-01T16:02:20.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24642025-08-01T16:02:20.044ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
24652025-08-01T16:02:20.044ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
24662025-08-01T16:02:20.044ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "264cd4ed-3078-42ef-a2f9-fa47b2b0b0d6", "date": "Fri, 01 Aug 2025 16:02:19 GMT"} })
24672025-08-01T16:02:20.044ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24682025-08-01T16:02:20.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24692025-08-01T16:02:20.047ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24702025-08-01T16:02:20.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24712025-08-01T16:02:20.050ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24722025-08-01T16:02:20.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24732025-08-01T16:02:20.053ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
24742025-08-01T16:02:20.053ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24752025-08-01T16:02:20.053ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
24762025-08-01T16:02:20.053ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 4c7da70d-ede0-4107-abc5-5650a053be38
24772025-08-01T16:02:20.054ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
24782025-08-01T16:02:20.054ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
24792025-08-01T16:02:20.054ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24802025-08-01T16:02:20.054ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24812025-08-01T16:02:20.054ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24822025-08-01T16:02:20.054ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24832025-08-01T16:02:20.054ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24842025-08-01T16:02:20.054ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24852025-08-01T16:02:20.054ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "23ee7202-ce42-44b6-87e8-c6ccf6423061", "date": "Fri, 01 Aug 2025 16:02:19 GMT"} })
24862025-08-01T16:02:20.054ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
24872025-08-01T16:02:20.054ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24882025-08-01T16:02:20.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24892025-08-01T16:02:20.056ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 296.147799ms iteration = 10 status = {}
24902025-08-01T16:02:20.057ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
24912025-08-01T16:02:20.057ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
24922025-08-01T16:02:20.235ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4947ce72-707a-4595-8c78-aa710ee1434d", "date": "Fri, 01 Aug 2025 16:02:19 GMT"} })
24932025-08-01T16:02:20.235ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch = Switch0
24942025-08-01T16:02:20.235ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
24952025-08-01T16:02:20.236ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "73d0c13c-3a29-42f4-acc8-887564db7679", "content-length": "682", "date": "Fri, 01 Aug 2025 16:02:20 GMT"} })
24962025-08-01T16:02:20.236ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24972025-08-01T16:02:20.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24982025-08-01T16:02:20.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24992025-08-01T16:02:20.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25002025-08-01T16:02:20.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25012025-08-01T16:02:20.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25022025-08-01T16:02:20.244ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25032025-08-01T16:02:20.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25042025-08-01T16:02:20.252ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 492.165463ms iteration = 10 status = {}
25052025-08-01T16:02:20.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9b6f6f27-488b-4ffc-8e6f-f04b0464815d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25062025-08-01T16:02:20.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9b6f6f27-488b-4ffc-8e6f-f04b0464815d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25072025-08-01T16:02:20.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 7363 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9b6f6f27-488b-4ffc-8e6f-f04b0464815d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25082025-08-01T16:02:21.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c9c31819-d998-4cf0-ac35-0d75aed91559 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25092025-08-01T16:02:21.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c9c31819-d998-4cf0-ac35-0d75aed91559 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25102025-08-01T16:02:21.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2111 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c9c31819-d998-4cf0-ac35-0d75aed91559 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25112025-08-01T16:02:22.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e2e04242-39a3-40a3-997c-25ed42d8dc58 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25122025-08-01T16:02:22.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e2e04242-39a3-40a3-997c-25ed42d8dc58 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25132025-08-01T16:02:22.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2634 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e2e04242-39a3-40a3-997c-25ed42d8dc58 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25142025-08-01T16:02:23.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 361fc00f-fdb1-4e53-8949-975d81ed6ca3 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25152025-08-01T16:02:23.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 361fc00f-fdb1-4e53-8949-975d81ed6ca3 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25162025-08-01T16:02:23.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2610 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 361fc00f-fdb1-4e53-8949-975d81ed6ca3 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25172025-08-01T16:02:24.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 56 reason = Timeout
25182025-08-01T16:02:24.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
25192025-08-01T16:02:24.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
25202025-08-01T16:02:24.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25212025-08-01T16:02:24.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
25222025-08-01T16:02:24.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
25232025-08-01T16:02:24.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
25242025-08-01T16:02:24.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
25252025-08-01T16:02:24.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.539709ms iteration = 56 status = {"chicken_switches_updated":false}
25262025-08-01T16:02:24.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 15ef546c-4477-4533-81f7-a15c1bd6a59e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25272025-08-01T16:02:24.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 15ef546c-4477-4533-81f7-a15c1bd6a59e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25282025-08-01T16:02:24.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2118 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 15ef546c-4477-4533-81f7-a15c1bd6a59e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25292025-08-01T16:02:25.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fcff0974-b78e-476f-a512-e0f5f5524b18 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25302025-08-01T16:02:25.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fcff0974-b78e-476f-a512-e0f5f5524b18 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25312025-08-01T16:02:25.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1941 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fcff0974-b78e-476f-a512-e0f5f5524b18 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25322025-08-01T16:02:26.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f7203892-9ade-4f35-b172-39941c7f11e0 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25332025-08-01T16:02:26.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f7203892-9ade-4f35-b172-39941c7f11e0 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25342025-08-01T16:02:26.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2440 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f7203892-9ade-4f35-b172-39941c7f11e0 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25352025-08-01T16:02:27.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5aa669a7-949d-41d0-a742-f3c8dd9686ad roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25362025-08-01T16:02:27.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5aa669a7-949d-41d0-a742-f3c8dd9686ad resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25372025-08-01T16:02:27.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2064 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5aa669a7-949d-41d0-a742-f3c8dd9686ad response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25382025-08-01T16:02:28.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b52e6c24-b2e2-44e6-8b2e-bc106b2c760d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25392025-08-01T16:02:28.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b52e6c24-b2e2-44e6-8b2e-bc106b2c760d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25402025-08-01T16:02:28.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2602 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b52e6c24-b2e2-44e6-8b2e-bc106b2c760d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25412025-08-01T16:02:29.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
25422025-08-01T16:02:29.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 57 reason = Timeout
25432025-08-01T16:02:29.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25442025-08-01T16:02:29.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
25452025-08-01T16:02:29.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
25462025-08-01T16:02:29.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25472025-08-01T16:02:29.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
25482025-08-01T16:02:29.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25492025-08-01T16:02:29.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25502025-08-01T16:02:29.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25512025-08-01T16:02:29.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25522025-08-01T16:02:29.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25532025-08-01T16:02:29.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25542025-08-01T16:02:29.763ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.419584ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25552025-08-01T16:02:29.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
25562025-08-01T16:02:29.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
25572025-08-01T16:02:29.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
25582025-08-01T16:02:29.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25592025-08-01T16:02:29.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25602025-08-01T16:02:29.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25612025-08-01T16:02:29.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
25622025-08-01T16:02:29.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.052184ms iteration = 57 status = {"chicken_switches_updated":false}
25632025-08-01T16:02:29.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25642025-08-01T16:02:29.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25652025-08-01T16:02:29.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25662025-08-01T16:02:29.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
25672025-08-01T16:02:29.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25682025-08-01T16:02:29.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25692025-08-01T16:02:29.788ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
25702025-08-01T16:02:29.788ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.573177ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
25712025-08-01T16:02:29.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1012 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = e5e6655c-c709-40dc-831e-6542c774432a response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
25722025-08-01T16:02:29.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 001a48e2-ced1-4777-a8e1-cf0b2f3e8f9a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25732025-08-01T16:02:29.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 001a48e2-ced1-4777-a8e1-cf0b2f3e8f9a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25742025-08-01T16:02:29.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1715 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 001a48e2-ced1-4777-a8e1-cf0b2f3e8f9a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25752025-08-01T16:02:30.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f61e26f0-f9dc-47db-b497-74308d946f2a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25762025-08-01T16:02:30.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f61e26f0-f9dc-47db-b497-74308d946f2a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25772025-08-01T16:02:30.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2215 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f61e26f0-f9dc-47db-b497-74308d946f2a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25782025-08-01T16:02:32.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8543f3cf-c2d0-4213-bd9c-2e46643a3878 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25792025-08-01T16:02:32.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8543f3cf-c2d0-4213-bd9c-2e46643a3878 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25802025-08-01T16:02:32.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2450 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8543f3cf-c2d0-4213-bd9c-2e46643a3878 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25812025-08-01T16:02:33.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5baf4323-bf43-4523-897d-2b22000a3b55 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25822025-08-01T16:02:33.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5baf4323-bf43-4523-897d-2b22000a3b55 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25832025-08-01T16:02:33.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 5621 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5baf4323-bf43-4523-897d-2b22000a3b55 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25842025-08-01T16:02:34.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6019e99d-b60c-43b5-8ef3-9c7049b5dfb5 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25852025-08-01T16:02:34.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6019e99d-b60c-43b5-8ef3-9c7049b5dfb5 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25862025-08-01T16:02:34.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2230 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6019e99d-b60c-43b5-8ef3-9c7049b5dfb5 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25872025-08-01T16:02:34.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 58 reason = Timeout
25882025-08-01T16:02:34.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
25892025-08-01T16:02:34.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
25902025-08-01T16:02:34.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25912025-08-01T16:02:34.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
25922025-08-01T16:02:34.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
25932025-08-01T16:02:34.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
25942025-08-01T16:02:34.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
25952025-08-01T16:02:34.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.873858ms iteration = 58 status = {"chicken_switches_updated":false}
25962025-08-01T16:02:35.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dbabacc6-9d70-4f03-900f-53090cd01287 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25972025-08-01T16:02:35.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dbabacc6-9d70-4f03-900f-53090cd01287 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25982025-08-01T16:02:35.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2492 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dbabacc6-9d70-4f03-900f-53090cd01287 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
25992025-08-01T16:02:36.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4cf54e53-4781-4030-87e6-059ed2ee7367 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26002025-08-01T16:02:36.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4cf54e53-4781-4030-87e6-059ed2ee7367 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26012025-08-01T16:02:36.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2411 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4cf54e53-4781-4030-87e6-059ed2ee7367 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26022025-08-01T16:02:37.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6b600868-97d6-44d1-aa02-cf01b42d53a2 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26032025-08-01T16:02:37.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6b600868-97d6-44d1-aa02-cf01b42d53a2 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26042025-08-01T16:02:37.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2311 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6b600868-97d6-44d1-aa02-cf01b42d53a2 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26052025-08-01T16:02:38.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 936a245b-0188-4be0-94d7-64aef2fe48ac roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26062025-08-01T16:02:38.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 936a245b-0188-4be0-94d7-64aef2fe48ac resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26072025-08-01T16:02:38.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2012 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 936a245b-0188-4be0-94d7-64aef2fe48ac response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26082025-08-01T16:02:39.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 49d41784-5aa8-4fb8-ac2f-290898703f6a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26092025-08-01T16:02:39.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 49d41784-5aa8-4fb8-ac2f-290898703f6a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26102025-08-01T16:02:39.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2021 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 49d41784-5aa8-4fb8-ac2f-290898703f6a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26112025-08-01T16:02:39.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
26122025-08-01T16:02:39.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26132025-08-01T16:02:39.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 59 reason = Timeout
26142025-08-01T16:02:39.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
26152025-08-01T16:02:39.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26162025-08-01T16:02:39.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
26172025-08-01T16:02:39.760ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
26182025-08-01T16:02:39.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26192025-08-01T16:02:39.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26202025-08-01T16:02:39.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26212025-08-01T16:02:39.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26222025-08-01T16:02:39.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26232025-08-01T16:02:39.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26242025-08-01T16:02:39.762ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.550508ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26252025-08-01T16:02:39.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
26262025-08-01T16:02:39.765ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
26272025-08-01T16:02:39.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
26282025-08-01T16:02:39.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26292025-08-01T16:02:39.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26302025-08-01T16:02:39.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26312025-08-01T16:02:39.767ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
26322025-08-01T16:02:39.767ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.675593ms iteration = 59 status = {"chicken_switches_updated":false}
26332025-08-01T16:02:39.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26342025-08-01T16:02:39.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26352025-08-01T16:02:39.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26362025-08-01T16:02:39.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
26372025-08-01T16:02:39.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26382025-08-01T16:02:39.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26392025-08-01T16:02:39.784ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
26402025-08-01T16:02:39.784ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.940316ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
26412025-08-01T16:02:39.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 625 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = f2b1e1a5-c129-4ec3-812f-dfcb5f45f199 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
26422025-08-01T16:02:40.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e4f7aafe-b588-43e6-b562-93f9ba27d764 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26432025-08-01T16:02:40.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e4f7aafe-b588-43e6-b562-93f9ba27d764 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26442025-08-01T16:02:40.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1599 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e4f7aafe-b588-43e6-b562-93f9ba27d764 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26452025-08-01T16:02:41.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ceaa9c82-e220-404e-8c93-d0ba59cc4387 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26462025-08-01T16:02:41.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ceaa9c82-e220-404e-8c93-d0ba59cc4387 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26472025-08-01T16:02:41.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2220 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ceaa9c82-e220-404e-8c93-d0ba59cc4387 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26482025-08-01T16:02:42.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e636dae0-2bd4-454c-a615-3047863d7040 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26492025-08-01T16:02:42.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e636dae0-2bd4-454c-a615-3047863d7040 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26502025-08-01T16:02:42.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2567 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e636dae0-2bd4-454c-a615-3047863d7040 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26512025-08-01T16:02:43.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 588277d3-ad6a-47ec-b7be-8ec0ed4a9bc9 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26522025-08-01T16:02:43.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 588277d3-ad6a-47ec-b7be-8ec0ed4a9bc9 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26532025-08-01T16:02:43.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1867 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 588277d3-ad6a-47ec-b7be-8ec0ed4a9bc9 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26542025-08-01T16:02:44.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 17f05646-66ae-4d0c-a7c1-2496ac297748 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26552025-08-01T16:02:44.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 17f05646-66ae-4d0c-a7c1-2496ac297748 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26562025-08-01T16:02:44.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2548 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 17f05646-66ae-4d0c-a7c1-2496ac297748 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26572025-08-01T16:02:44.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 60 reason = Timeout
26582025-08-01T16:02:44.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
26592025-08-01T16:02:44.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
26602025-08-01T16:02:44.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26612025-08-01T16:02:44.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
26622025-08-01T16:02:44.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
26632025-08-01T16:02:44.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
26642025-08-01T16:02:44.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
26652025-08-01T16:02:44.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.659322ms iteration = 60 status = {"chicken_switches_updated":false}
26662025-08-01T16:02:44.913ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::d]:56079
26672025-08-01T16:02:44.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56079 req_id = a2e621eb-0dc6-45c4-8057-beb34b338ffc roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
26682025-08-01T16:02:44.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56079 req_id = a2e621eb-0dc6-45c4-8057-beb34b338ffc resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
26692025-08-01T16:02:44.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3137 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56079 req_id = a2e621eb-0dc6-45c4-8057-beb34b338ffc response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
26702025-08-01T16:02:44.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56079 req_id = c2ce598b-143f-4b9f-b035-bf7cde19f72b roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
26712025-08-01T16:02:44.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56079 req_id = c2ce598b-143f-4b9f-b035-bf7cde19f72b resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
26722025-08-01T16:02:44.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2200 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56079 req_id = c2ce598b-143f-4b9f-b035-bf7cde19f72b response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
26732025-08-01T16:02:45.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 955a14fd-ff7e-492b-b4fb-f204054c6a5a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26742025-08-01T16:02:45.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 955a14fd-ff7e-492b-b4fb-f204054c6a5a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26752025-08-01T16:02:45.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2455 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 955a14fd-ff7e-492b-b4fb-f204054c6a5a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26762025-08-01T16:02:46.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9904b919-117e-4e07-87d1-3a0b293094e4 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26772025-08-01T16:02:46.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9904b919-117e-4e07-87d1-3a0b293094e4 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26782025-08-01T16:02:46.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1979 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9904b919-117e-4e07-87d1-3a0b293094e4 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26792025-08-01T16:02:47.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bc49d896-011f-4d7c-8efd-90d9fc6ea511 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26802025-08-01T16:02:47.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bc49d896-011f-4d7c-8efd-90d9fc6ea511 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26812025-08-01T16:02:47.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2311 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bc49d896-011f-4d7c-8efd-90d9fc6ea511 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26822025-08-01T16:02:48.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c22773f4-4b3a-4b86-939a-6291ca4726e9 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26832025-08-01T16:02:48.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c22773f4-4b3a-4b86-939a-6291ca4726e9 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26842025-08-01T16:02:48.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2353 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c22773f4-4b3a-4b86-939a-6291ca4726e9 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26852025-08-01T16:02:49.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9f7b4d3e-8e3a-4e62-9a9d-158a7371d439 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26862025-08-01T16:02:49.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9f7b4d3e-8e3a-4e62-9a9d-158a7371d439 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26872025-08-01T16:02:49.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2352 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9f7b4d3e-8e3a-4e62-9a9d-158a7371d439 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
26882025-08-01T16:02:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
26892025-08-01T16:02:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
26902025-08-01T16:02:49.688ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
26912025-08-01T16:02:49.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26922025-08-01T16:02:49.688ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
26932025-08-01T16:02:49.688ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-01 15:52:49.688149249 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
26942025-08-01T16:02:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
26952025-08-01T16:02:49.688ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
26962025-08-01T16:02:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
26972025-08-01T16:02:49.688ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
26982025-08-01T16:02:49.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26992025-08-01T16:02:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
27002025-08-01T16:02:49.688ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
27012025-08-01T16:02:49.688ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
27022025-08-01T16:02:49.688ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27032025-08-01T16:02:49.688ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27042025-08-01T16:02:49.688ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
27052025-08-01T16:02:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
27062025-08-01T16:02:49.688ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
27072025-08-01T16:02:49.688ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
27082025-08-01T16:02:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27092025-08-01T16:02:49.688ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cb706a84-a33b-442f-aac2-3a6eb5f3b330.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d688a68d-d771-4ac5-8e66-9efa94dbbea8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d688a68d-d771-4ac5-8e66-9efa94dbbea8.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 43865, tv_nsec: 704410577 } })
27102025-08-01T16:02:49.688ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50fe31de-3241-42df-a386-de37ce323a34.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("58598327-8751-423c-a5ac-c610829651e2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 43865, tv_nsec: 704446578 } })
27112025-08-01T16:02:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27122025-08-01T16:02:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27132025-08-01T16:02:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
27142025-08-01T16:02:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
27152025-08-01T16:02:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27162025-08-01T16:02:49.689ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
27172025-08-01T16:02:49.689ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.025831ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
27182025-08-01T16:02:49.689ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
27192025-08-01T16:02:49.689ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27202025-08-01T16:02:49.689ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.124834ms iteration = 6 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
27212025-08-01T16:02:49.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27222025-08-01T16:02:49.690ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27232025-08-01T16:02:49.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27242025-08-01T16:02:49.691ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43865, tv_nsec: 706923074 } })
27252025-08-01T16:02:49.691ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
27262025-08-01T16:02:49.691ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.528647ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
27272025-08-01T16:02:49.692ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-01 15:52:49.688149249 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
27282025-08-01T16:02:49.692ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.043353ms iteration = 6 status = {"expiration":"2025-08-01T15:52:49.688149249Z","pruned":[]}
27292025-08-01T16:02:49.692ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27302025-08-01T16:02:49.693ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43865, tv_nsec: 708948155 } })
27312025-08-01T16:02:49.693ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
27322025-08-01T16:02:49.693ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27332025-08-01T16:02:49.693ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27342025-08-01T16:02:49.695ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
27352025-08-01T16:02:49.695ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27362025-08-01T16:02:49.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27372025-08-01T16:02:49.697ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27382025-08-01T16:02:49.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27392025-08-01T16:02:49.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
27402025-08-01T16:02:49.699ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
27412025-08-01T16:02:49.699ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27422025-08-01T16:02:49.700ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
27432025-08-01T16:02:49.700ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
27442025-08-01T16:02:49.700ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
27452025-08-01T16:02:49.700ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27462025-08-01T16:02:49.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27472025-08-01T16:02:49.702ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27482025-08-01T16:02:49.705ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
27492025-08-01T16:02:49.705ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27502025-08-01T16:02:49.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27512025-08-01T16:02:49.706ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
27522025-08-01T16:02:49.706ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27532025-08-01T16:02:49.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27542025-08-01T16:02:49.706ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
27552025-08-01T16:02:49.706ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1
27562025-08-01T16:02:49.707ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.81\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1"}
27572025-08-01T16:02:49.708ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27582025-08-01T16:02:49.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27592025-08-01T16:02:49.708ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
27602025-08-01T16:02:49.708ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6482e44c-c860-4033-b945-5707d343a59d dns_zone_name = oxide.test found_so_far = 0 version = 2
27612025-08-01T16:02:49.708ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27622025-08-01T16:02:49.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27632025-08-01T16:02:49.710ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27642025-08-01T16:02:49.710ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 4 reason = Timeout
27652025-08-01T16:02:49.710ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 9 reason = Timeout
27662025-08-01T16:02:49.710ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
27672025-08-01T16:02:49.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
27682025-08-01T16:02:49.710ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 8.2\u{b5}s iteration = 9 status = "Disabled"
27692025-08-01T16:02:49.710ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27702025-08-01T16:02:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
27712025-08-01T16:02:49.710ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 2 reason = Timeout
27722025-08-01T16:02:49.710ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
27732025-08-01T16:02:49.710ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
27742025-08-01T16:02:49.710ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
27752025-08-01T16:02:49.710ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
27762025-08-01T16:02:49.710ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
27772025-08-01T16:02:49.710ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
27782025-08-01T16:02:49.710ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
27792025-08-01T16:02:49.710ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 6 reason = Timeout
27802025-08-01T16:02:49.710ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
27812025-08-01T16:02:49.710ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
27822025-08-01T16:02:49.710ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 6 reason = Timeout
27832025-08-01T16:02:49.711ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
27842025-08-01T16:02:49.711ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
27852025-08-01T16:02:49.711ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
27862025-08-01T16:02:49.711ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
27872025-08-01T16:02:49.711ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
27882025-08-01T16:02:49.711ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27892025-08-01T16:02:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
27902025-08-01T16:02:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
27912025-08-01T16:02:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
27922025-08-01T16:02:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
27932025-08-01T16:02:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
27942025-08-01T16:02:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
27952025-08-01T16:02:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27962025-08-01T16:02:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
27972025-08-01T16:02:49.712ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27982025-08-01T16:02:49.712ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27992025-08-01T16:02:49.713ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28002025-08-01T16:02:49.715ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
28012025-08-01T16:02:49.715ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28022025-08-01T16:02:49.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28032025-08-01T16:02:49.715ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.811786ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
28042025-08-01T16:02:49.716ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
28052025-08-01T16:02:49.716ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 5.549608ms iteration = 6 status = {"by_rx":{},"error":null}
28062025-08-01T16:02:49.717ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
28072025-08-01T16:02:49.717ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
28082025-08-01T16:02:49.717ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 6.412694ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
28092025-08-01T16:02:49.717ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
28102025-08-01T16:02:49.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
28112025-08-01T16:02:49.717ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28122025-08-01T16:02:49.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
28132025-08-01T16:02:49.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
28142025-08-01T16:02:49.718ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
28152025-08-01T16:02:49.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28162025-08-01T16:02:49.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
28172025-08-01T16:02:49.718ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
28182025-08-01T16:02:49.718ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
28192025-08-01T16:02:49.718ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
28202025-08-01T16:02:49.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
28212025-08-01T16:02:49.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
28222025-08-01T16:02:49.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
28232025-08-01T16:02:49.720ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
28242025-08-01T16:02:49.720ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
28252025-08-01T16:02:49.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
28262025-08-01T16:02:49.721ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
28272025-08-01T16:02:49.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
28282025-08-01T16:02:49.721ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6482e44c-c860-4033-b945-5707d343a59d dns_zone_name = oxide.test found_so_far = 4 version = 2
28292025-08-01T16:02:49.721ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
28302025-08-01T16:02:49.721ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-01 15:58:34.713515 UTC dns_group = external generation = 2
28312025-08-01T16:02:49.721ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 33.068253ms iteration = 6 status = {"generation":2}
28322025-08-01T16:02:49.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
28332025-08-01T16:02:49.729ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28342025-08-01T16:02:49.734ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
28352025-08-01T16:02:49.734ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
28362025-08-01T16:02:49.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
28372025-08-01T16:02:49.737ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
28382025-08-01T16:02:49.737ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
28392025-08-01T16:02:49.737ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
28402025-08-01T16:02:49.737ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 26.786582ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
28412025-08-01T16:02:49.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
28422025-08-01T16:02:49.739ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 28.549586ms iteration = 6 status = {"dispatched":[],"errors":[],"glob_version":"173.0.0","globs_reprocessed":{},"no_receivers":[]}
28432025-08-01T16:02:49.740ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
28442025-08-01T16:02:49.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
28452025-08-01T16:02:49.745ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
28462025-08-01T16:02:49.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
28472025-08-01T16:02:49.747ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28482025-08-01T16:02:49.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
28492025-08-01T16:02:49.752ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
28502025-08-01T16:02:49.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
28512025-08-01T16:02:49.757ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
28522025-08-01T16:02:49.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
28532025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 11 reason = Timeout
28542025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 13.64\u{b5}s iteration = 11 status = {"disabled":true,"errors":[],"sps":[]}
28552025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
28562025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
28572025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
28582025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28592025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
28602025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
28612025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28622025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28632025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
28642025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
28652025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
28662025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28672025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28682025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
28692025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28702025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
28712025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
28722025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
28732025-08-01T16:02:49.759ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
28742025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 11 reason = Timeout
28752025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
28762025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28772025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
28782025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28792025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
28802025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28812025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
28822025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28832025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
28842025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28852025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 61 reason = Timeout
28862025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
28872025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28882025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28892025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
28902025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
28912025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28922025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28932025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28942025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
28952025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28962025-08-01T16:02:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28972025-08-01T16:02:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28982025-08-01T16:02:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28992025-08-01T16:02:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29002025-08-01T16:02:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
29012025-08-01T16:02:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
29022025-08-01T16:02:49.760ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 11 reason = Timeout
29032025-08-01T16:02:49.760ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
29042025-08-01T16:02:49.760ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29052025-08-01T16:02:49.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29062025-08-01T16:02:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29072025-08-01T16:02:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
29082025-08-01T16:02:49.761ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29092025-08-01T16:02:49.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29102025-08-01T16:02:49.762ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29112025-08-01T16:02:49.762ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
29122025-08-01T16:02:49.762ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29132025-08-01T16:02:49.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29142025-08-01T16:02:49.762ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29152025-08-01T16:02:49.762ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.695502ms iteration = 11 status = {"errors":[],"finish_invoked_ok":[]}
29162025-08-01T16:02:49.765ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29172025-08-01T16:02:49.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29182025-08-01T16:02:49.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
29192025-08-01T16:02:49.766ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29202025-08-01T16:02:49.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29212025-08-01T16:02:49.767ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29222025-08-01T16:02:49.767ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29232025-08-01T16:02:49.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29242025-08-01T16:02:49.769ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29252025-08-01T16:02:49.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
29262025-08-01T16:02:49.770ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29272025-08-01T16:02:49.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29282025-08-01T16:02:49.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29292025-08-01T16:02:49.771ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29302025-08-01T16:02:49.773ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29312025-08-01T16:02:49.773ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29322025-08-01T16:02:49.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29332025-08-01T16:02:49.773ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29342025-08-01T16:02:49.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29352025-08-01T16:02:49.774ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
29362025-08-01T16:02:49.774ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
29372025-08-01T16:02:49.774ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
29382025-08-01T16:02:49.774ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29392025-08-01T16:02:49.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29402025-08-01T16:02:49.776ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 16.905703ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
29412025-08-01T16:02:49.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
29422025-08-01T16:02:49.776ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29432025-08-01T16:02:49.777ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29442025-08-01T16:02:49.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
29452025-08-01T16:02:49.778ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43865, tv_nsec: 794550371 } })
29462025-08-01T16:02:49.779ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29472025-08-01T16:02:49.779ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29482025-08-01T16:02:49.779ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29492025-08-01T16:02:49.779ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
29502025-08-01T16:02:49.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29512025-08-01T16:02:49.781ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29522025-08-01T16:02:49.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29532025-08-01T16:02:49.782ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29542025-08-01T16:02:49.782ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29552025-08-01T16:02:49.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29562025-08-01T16:02:49.782ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29572025-08-01T16:02:49.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29582025-08-01T16:02:49.785ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29592025-08-01T16:02:49.785ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
29602025-08-01T16:02:49.785ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29612025-08-01T16:02:49.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29622025-08-01T16:02:49.789ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
29632025-08-01T16:02:49.789ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 02fcb774-aa43-4052-9996-b85e2d1358b5 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
29642025-08-01T16:02:49.789ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29652025-08-01T16:02:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29662025-08-01T16:02:49.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
29672025-08-01T16:02:49.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29682025-08-01T16:02:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29692025-08-01T16:02:49.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29702025-08-01T16:02:49.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
29712025-08-01T16:02:49.800ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29722025-08-01T16:02:49.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29732025-08-01T16:02:49.806ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 02fcb774-aa43-4052-9996-b85e2d1358b5 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
29742025-08-01T16:02:49.806ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
29752025-08-01T16:02:49.806ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-01 15:58:34.032744 UTC dns_group = internal generation = 1
29762025-08-01T16:02:49.806ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 118.691689ms iteration = 6 status = {"generation":1}
29772025-08-01T16:02:49.837ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29782025-08-01T16:02:49.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29792025-08-01T16:02:49.838ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-01T15:57:44.766264Z, time_modified: 2025-08-01T15:57:44.766264Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: eec17da7-eb17-4917-8728-908698b69bbe, db_silo: Silo { identity: SiloIdentity { id: eec17da7-eb17-4917-8728-908698b69bbe, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-01T15:58:34.653875Z, time_modified: 2025-08-01T15:58:34.653875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: eec17da7-eb17-4917-8728-908698b69bbe, db_silo: Silo { identity: SiloIdentity { id: eec17da7-eb17-4917-8728-908698b69bbe, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-01T15:58:34.653875Z, time_modified: 2025-08-01T15:58:34.653875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575" }] }) }
29802025-08-01T16:02:49.838ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 150.236776ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"eec17da7-eb17-4917-8728-908698b69bbe","tls_certs":["b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575"]}},"default_endpoint":{"silo_id":"eec17da7-eb17-4917-8728-908698b69bbe","tls_certs":["b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
29812025-08-01T16:02:49.844ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29822025-08-01T16:02:49.844ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 84.982177ms iteration = 11 status = {"errors":[],"requests_created_ok":[]}
29832025-08-01T16:02:49.845ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29842025-08-01T16:02:49.848ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
29852025-08-01T16:02:49.848ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 88.269406ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
29862025-08-01T16:02:49.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
29872025-08-01T16:02:49.848ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
29882025-08-01T16:02:49.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
29892025-08-01T16:02:49.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
29902025-08-01T16:02:49.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
29912025-08-01T16:02:49.850ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 91.335159ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
29922025-08-01T16:02:49.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
29932025-08-01T16:02:49.851ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29942025-08-01T16:02:49.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29952025-08-01T16:02:49.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29962025-08-01T16:02:49.851ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
29972025-08-01T16:02:49.851ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 92.310109ms iteration = 61 status = {"chicken_switches_updated":false}
29982025-08-01T16:02:49.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29992025-08-01T16:02:49.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30002025-08-01T16:02:49.854ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30012025-08-01T16:02:49.854ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
30022025-08-01T16:02:49.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30032025-08-01T16:02:49.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30042025-08-01T16:02:49.855ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 95.985581ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
30052025-08-01T16:02:49.855ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
30062025-08-01T16:02:49.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
30072025-08-01T16:02:49.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
30082025-08-01T16:02:49.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30092025-08-01T16:02:49.857ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
30102025-08-01T16:02:49.857ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 98.572798ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
30112025-08-01T16:02:49.858ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30122025-08-01T16:02:49.858ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30132025-08-01T16:02:49.860ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
30142025-08-01T16:02:49.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
30152025-08-01T16:02:49.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
30162025-08-01T16:02:49.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30172025-08-01T16:02:49.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30182025-08-01T16:02:49.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30192025-08-01T16:02:49.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 103.56842ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30202025-08-01T16:02:49.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
30212025-08-01T16:02:49.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
30222025-08-01T16:02:49.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
30232025-08-01T16:02:49.864ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30242025-08-01T16:02:49.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30252025-08-01T16:02:49.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30262025-08-01T16:02:49.864ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
30272025-08-01T16:02:49.865ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30282025-08-01T16:02:49.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
30292025-08-01T16:02:49.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30302025-08-01T16:02:49.866ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30312025-08-01T16:02:49.867ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
30322025-08-01T16:02:49.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
30332025-08-01T16:02:49.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
30342025-08-01T16:02:49.867ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30352025-08-01T16:02:49.868ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30362025-08-01T16:02:49.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30372025-08-01T16:02:49.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
30382025-08-01T16:02:49.871ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30392025-08-01T16:02:49.871ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
30402025-08-01T16:02:49.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
30412025-08-01T16:02:49.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30422025-08-01T16:02:49.871ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30432025-08-01T16:02:49.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30442025-08-01T16:02:49.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30452025-08-01T16:02:49.873ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:391
30462025-08-01T16:02:49.873ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 112.851162ms iteration = 11 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
30472025-08-01T16:02:49.874ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30482025-08-01T16:02:49.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30492025-08-01T16:02:49.874ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
30502025-08-01T16:02:49.875ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30512025-08-01T16:02:49.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30522025-08-01T16:02:49.875ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
30532025-08-01T16:02:49.875ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30542025-08-01T16:02:49.876ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bac47ca3-ba7f-4f7f-b472-2944dbbb6a40", "content-length": "26", "date": "Fri, 01 Aug 2025 16:02:49 GMT"} })
30552025-08-01T16:02:49.876ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30562025-08-01T16:02:49.876ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30572025-08-01T16:02:49.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30582025-08-01T16:02:49.877ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30592025-08-01T16:02:49.877ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30602025-08-01T16:02:49.878ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30612025-08-01T16:02:49.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30622025-08-01T16:02:49.880ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30632025-08-01T16:02:49.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30642025-08-01T16:02:49.881ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30652025-08-01T16:02:49.881ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30662025-08-01T16:02:49.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30672025-08-01T16:02:49.883ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30682025-08-01T16:02:49.886ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30692025-08-01T16:02:49.886ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30702025-08-01T16:02:49.886ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30712025-08-01T16:02:49.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30722025-08-01T16:02:49.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
30732025-08-01T16:02:49.892ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30742025-08-01T16:02:49.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30752025-08-01T16:02:49.893ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
30762025-08-01T16:02:49.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
30772025-08-01T16:02:49.894ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30782025-08-01T16:02:49.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30792025-08-01T16:02:49.897ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30802025-08-01T16:02:49.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30812025-08-01T16:02:49.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30822025-08-01T16:02:49.900ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
30832025-08-01T16:02:49.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
30842025-08-01T16:02:49.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
30852025-08-01T16:02:49.904ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30862025-08-01T16:02:49.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30872025-08-01T16:02:49.906ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30882025-08-01T16:02:49.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30892025-08-01T16:02:49.908ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30902025-08-01T16:02:49.908ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
30912025-08-01T16:02:49.908ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 149.08295ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
30922025-08-01T16:02:49.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
30932025-08-01T16:02:49.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
30942025-08-01T16:02:49.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30952025-08-01T16:02:49.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30962025-08-01T16:02:49.917ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30972025-08-01T16:02:49.918ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30982025-08-01T16:02:49.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30992025-08-01T16:02:49.919ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31002025-08-01T16:02:49.919ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
31012025-08-01T16:02:49.919ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
31022025-08-01T16:02:49.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
31032025-08-01T16:02:49.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 621 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = a34e6a7a-9021-4a61-a520-8a67822c9379 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
31042025-08-01T16:02:49.921ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31052025-08-01T16:02:49.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31062025-08-01T16:02:49.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
31072025-08-01T16:02:49.923ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31082025-08-01T16:02:49.923ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31092025-08-01T16:02:49.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31102025-08-01T16:02:49.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31112025-08-01T16:02:49.924ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
31122025-08-01T16:02:49.924ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
31132025-08-01T16:02:49.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
31142025-08-01T16:02:49.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
31152025-08-01T16:02:49.925ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 166.308063ms iteration = 11 status = 0
31162025-08-01T16:02:49.925ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31172025-08-01T16:02:49.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31182025-08-01T16:02:49.926ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31192025-08-01T16:02:49.926ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31202025-08-01T16:02:49.926ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
31212025-08-01T16:02:49.926ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31222025-08-01T16:02:49.927ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "de5c0159-5ff7-4013-9d71-313e466f7967", "content-length": "26", "date": "Fri, 01 Aug 2025 16:02:49 GMT"} })
31232025-08-01T16:02:49.927ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31242025-08-01T16:02:49.928ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31252025-08-01T16:02:49.928ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
31262025-08-01T16:02:49.928ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
31272025-08-01T16:02:49.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
31282025-08-01T16:02:49.929ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
31292025-08-01T16:02:49.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
31302025-08-01T16:02:49.930ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31312025-08-01T16:02:49.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
31322025-08-01T16:02:49.930ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
31332025-08-01T16:02:49.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
31342025-08-01T16:02:49.932ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
31352025-08-01T16:02:49.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
31362025-08-01T16:02:49.934ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31372025-08-01T16:02:49.935ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
31382025-08-01T16:02:49.935ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31392025-08-01T16:02:49.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31402025-08-01T16:02:49.936ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31412025-08-01T16:02:49.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31422025-08-01T16:02:49.937ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
31432025-08-01T16:02:49.937ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
31442025-08-01T16:02:49.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
31452025-08-01T16:02:49.938ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31462025-08-01T16:02:49.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31472025-08-01T16:02:49.940ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31482025-08-01T16:02:49.940ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
31492025-08-01T16:02:49.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
31502025-08-01T16:02:49.941ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 181.890205ms iteration = 13 status = {"physical_disks_added":0}
31512025-08-01T16:02:49.941ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
31522025-08-01T16:02:49.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
31532025-08-01T16:02:49.942ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31542025-08-01T16:02:49.943ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31552025-08-01T16:02:49.946ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
31562025-08-01T16:02:49.946ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31572025-08-01T16:02:49.946ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
31582025-08-01T16:02:49.946ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
31592025-08-01T16:02:49.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31602025-08-01T16:02:49.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
31612025-08-01T16:02:49.947ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
31622025-08-01T16:02:49.947ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
31632025-08-01T16:02:49.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
31642025-08-01T16:02:49.949ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = tuf_artifact_replication body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/artifacts-config
31652025-08-01T16:02:49.950ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
31662025-08-01T16:02:49.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
31672025-08-01T16:02:49.951ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31682025-08-01T16:02:49.952ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts-config", status: 204, headers: {"x-request-id": "9b830646-4769-4ff5-9a6f-8ebab0cfd47c", "date": "Fri, 01 Aug 2025 16:02:49 GMT"} })
31692025-08-01T16:02:49.952ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
31702025-08-01T16:02:49.953ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "fdf3968a-3ced-461c-b734-60e58b50da85", "content-length": "26", "date": "Fri, 01 Aug 2025 16:02:49 GMT"} })
31712025-08-01T16:02:49.953ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:672 sled = http://[fd00:1122:3344:101::1]:12345
31722025-08-01T16:02:49.954ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31732025-08-01T16:02:49.954ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
31742025-08-01T16:02:49.954ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
31752025-08-01T16:02:49.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31762025-08-01T16:02:49.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
31772025-08-01T16:02:49.955ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 244.809573ms iteration = 2 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"generation":1,"operation":"put_config","target_sled":"c9f3bda2-4996-4bda-a233-772410078d0a","time":"2025-08-01T16:02:49.952832654Z"},{"operation":"list","target_sled":"c9f3bda2-4996-4bda-a233-772410078d0a","time":"2025-08-01T16:02:49.953808154Z"}]}
31782025-08-01T16:02:49.956ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31792025-08-01T16:02:49.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31802025-08-01T16:02:49.958ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
31812025-08-01T16:02:49.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
31822025-08-01T16:02:49.959ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31832025-08-01T16:02:49.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31842025-08-01T16:02:49.960ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31852025-08-01T16:02:49.963ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31862025-08-01T16:02:49.963ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
31872025-08-01T16:02:49.963ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
31882025-08-01T16:02:49.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31892025-08-01T16:02:49.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
31902025-08-01T16:02:49.966ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31912025-08-01T16:02:49.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31922025-08-01T16:02:49.969ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31932025-08-01T16:02:49.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31942025-08-01T16:02:49.969ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
31952025-08-01T16:02:49.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
31962025-08-01T16:02:49.970ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 211.521593ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
31972025-08-01T16:02:49.971ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31982025-08-01T16:02:49.971ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31992025-08-01T16:02:49.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32002025-08-01T16:02:49.973ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
32012025-08-01T16:02:49.973ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
32022025-08-01T16:02:49.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
32032025-08-01T16:02:49.973ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32042025-08-01T16:02:49.977ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
32052025-08-01T16:02:49.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
32062025-08-01T16:02:49.978ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
32072025-08-01T16:02:49.978ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32082025-08-01T16:02:49.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32092025-08-01T16:02:49.979ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32102025-08-01T16:02:49.980ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32112025-08-01T16:02:49.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32122025-08-01T16:02:49.981ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
32132025-08-01T16:02:49.981ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
32142025-08-01T16:02:49.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
32152025-08-01T16:02:49.982ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32162025-08-01T16:02:49.982ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
32172025-08-01T16:02:49.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32182025-08-01T16:02:49.983ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32192025-08-01T16:02:49.984ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32202025-08-01T16:02:49.986ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
32212025-08-01T16:02:49.986ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
32222025-08-01T16:02:49.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
32232025-08-01T16:02:49.987ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 zone_address = fd00:1122:3344:101::2
32242025-08-01T16:02:49.987ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32252025-08-01T16:02:49.988ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0af097a-7f0f-4dcf-b82e-a58d45128da9", "content-length": "26", "date": "Fri, 01 Aug 2025 16:02:49 GMT"} })
32262025-08-01T16:02:49.988ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32272025-08-01T16:02:49.989ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
32282025-08-01T16:02:49.989ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32292025-08-01T16:02:49.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32302025-08-01T16:02:49.990ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
32312025-08-01T16:02:49.992ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
32322025-08-01T16:02:49.996ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 674b1238-f8d3-485d-ac9a-18ae283a4c3f, kind: Service { id: d688a68d-d771-4ac5-8e66-9efa94dbbea8 }, name: Name("external-dns-d688a68d-d771-4ac5-8e66-9efa94dbbea8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 26])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 71946e26-41e0-47b5-a3f1-1dc1f88d6f19, kind: Service { id: cb706a84-a33b-442f-aac2-3a6eb5f3b330 }, name: Name("external-dns-cb706a84-a33b-442f-aac2-3a6eb5f3b330"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 140])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 04b363be-ccb0-479c-9061-146e0f3cd0f5, kind: Service { id: 47e81fb5-17f5-43c3-b06b-bf529b9c19c7 }, name: Name("nexus-47e81fb5-17f5-43c3-b06b-bf529b9c19c7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1a7b404e-03d2-462c-b83f-716d429c5ce6, kind: Service { id: 7248190d-c184-423c-8431-31fe40a79e2e }, name: Name("nexus-7248190d-c184-423c-8431-31fe40a79e2e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d893583b-243d-4d0f-855b-7369e8e9fbf2, kind: Service { id: 8dfddf96-9f2d-4f96-9bf8-8181bf947a28 }, name: Name("nexus-8dfddf96-9f2d-4f96-9bf8-8181bf947a28"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 228])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
32332025-08-01T16:02:49.996ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32342025-08-01T16:02:49.996ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 286.676503ms iteration = 4 status = {"blueprint_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","inventory_collection_id":"35b490cb-703f-4148-b034-9706bbcc0602","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":9,"num_not_in_inventory":0,"num_tombstoned":0}}}
32352025-08-01T16:02:49.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32362025-08-01T16:02:49.998ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32372025-08-01T16:02:50.001ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
32382025-08-01T16:02:50.001ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32392025-08-01T16:02:50.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32402025-08-01T16:02:50.003ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
32412025-08-01T16:02:50.003ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 674b1238-f8d3-485d-ac9a-18ae283a4c3f, kind: Service { id: d688a68d-d771-4ac5-8e66-9efa94dbbea8 }, name: Name("external-dns-d688a68d-d771-4ac5-8e66-9efa94dbbea8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 26])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 71946e26-41e0-47b5-a3f1-1dc1f88d6f19, kind: Service { id: cb706a84-a33b-442f-aac2-3a6eb5f3b330 }, name: Name("external-dns-cb706a84-a33b-442f-aac2-3a6eb5f3b330"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 140])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 04b363be-ccb0-479c-9061-146e0f3cd0f5, kind: Service { id: 47e81fb5-17f5-43c3-b06b-bf529b9c19c7 }, name: Name("nexus-47e81fb5-17f5-43c3-b06b-bf529b9c19c7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1a7b404e-03d2-462c-b83f-716d429c5ce6, kind: Service { id: 7248190d-c184-423c-8431-31fe40a79e2e }, name: Name("nexus-7248190d-c184-423c-8431-31fe40a79e2e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d893583b-243d-4d0f-855b-7369e8e9fbf2, kind: Service { id: 8dfddf96-9f2d-4f96-9bf8-8181bf947a28 }, name: Name("nexus-8dfddf96-9f2d-4f96-9bf8-8181bf947a28"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 228])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 674b1238-f8d3-485d-ac9a-18ae283a4c3f, kind: Service { id: d688a68d-d771-4ac5-8e66-9efa94dbbea8 }, name: Name("external-dns-d688a68d-d771-4ac5-8e66-9efa94dbbea8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 26])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 71946e26-41e0-47b5-a3f1-1dc1f88d6f19, kind: Service { id: cb706a84-a33b-442f-aac2-3a6eb5f3b330 }, name: Name("external-dns-cb706a84-a33b-442f-aac2-3a6eb5f3b330"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 140])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 3, code: Some(IcmpParamRange { first: 3, last: 4 }) })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 5, code: None })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 11, code: None }))]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 04b363be-ccb0-479c-9061-146e0f3cd0f5, kind: Service { id: 47e81fb5-17f5-43c3-b06b-bf529b9c19c7 }, name: Name("nexus-47e81fb5-17f5-43c3-b06b-bf529b9c19c7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1a7b404e-03d2-462c-b83f-716d429c5ce6, kind: Service { id: 7248190d-c184-423c-8431-31fe40a79e2e }, name: Name("nexus-7248190d-c184-423c-8431-31fe40a79e2e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d893583b-243d-4d0f-855b-7369e8e9fbf2, kind: Service { id: 8dfddf96-9f2d-4f96-9bf8-8181bf947a28 }, name: Name("nexus-8dfddf96-9f2d-4f96-9bf8-8181bf947a28"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 228])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }]
32422025-08-01T16:02:50.003ZDEBGnexus (service-firewall-rule-progator): resolved 3 rules for sleds background_task = service_firewall_rule_propagation
32432025-08-01T16:02:50.045ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
32442025-08-01T16:02:50.046ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32452025-08-01T16:02:50.046ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "39877317-c000-43c2-b3e9-946770c22d4e", "content-length": "372", "date": "Fri, 01 Aug 2025 16:02:49 GMT"} })
32462025-08-01T16:02:50.046ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32472025-08-01T16:02:50.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32482025-08-01T16:02:50.054ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
32492025-08-01T16:02:50.065ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
32502025-08-01T16:02:50.065ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
32512025-08-01T16:02:50.065ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c877ef6d-8750-4770-97fb-775fb84fe952", "date": "Fri, 01 Aug 2025 16:02:49 GMT"} })
32522025-08-01T16:02:50.065ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32532025-08-01T16:02:50.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32542025-08-01T16:02:50.068ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32552025-08-01T16:02:50.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32562025-08-01T16:02:50.073ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32572025-08-01T16:02:50.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32582025-08-01T16:02:50.082ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32592025-08-01T16:02:50.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32602025-08-01T16:02:50.083ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
32612025-08-01T16:02:50.083ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32622025-08-01T16:02:50.083ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b50d7711-fd1e-4eae-82ab-da9ce9aa42c4", "date": "Fri, 01 Aug 2025 16:02:49 GMT"} })
32632025-08-01T16:02:50.085ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 325.928302ms iteration = 11 status = {}
32642025-08-01T16:02:50.085ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 397.337478ms iteration = 11 status = null
32652025-08-01T16:02:50.090ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: c9f3bda2-4996-4bda-a233-772410078d0a, time_created: 2025-08-01T15:58:33.455031Z, time_modified: 2025-08-01T15:58:33.455031Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(56094621696)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
32662025-08-01T16:02:50.090ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
32672025-08-01T16:02:50.129ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
32682025-08-01T16:02:50.129ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 418.19761ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
32692025-08-01T16:02:50.129ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 441.549768ms iteration = 11 status = {}
32702025-08-01T16:02:50.194ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
32712025-08-01T16:02:50.194ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
32722025-08-01T16:02:50.195ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "38686697-7f6e-4f39-aa32-05beedf5e286", "date": "Fri, 01 Aug 2025 16:02:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
32732025-08-01T16:02:50.195ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
32742025-08-01T16:02:50.195ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d23246d2-834d-46b8-a424-8d72744ce866", "date": "Fri, 01 Aug 2025 16:02:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
32752025-08-01T16:02:50.195ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
32762025-08-01T16:02:50.196ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
32772025-08-01T16:02:50.196ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e17afcf-3fe6-4dd6-8ec9-bc4c94e9e1da", "content-length": "691", "date": "Fri, 01 Aug 2025 16:02:49 GMT"} })
32782025-08-01T16:02:50.196ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
32792025-08-01T16:02:50.197ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
32802025-08-01T16:02:50.197ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
32812025-08-01T16:02:50.201ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "861594c2-4918-4df7-a4a1-b993bf254b08", "date": "Fri, 01 Aug 2025 16:02:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
32822025-08-01T16:02:50.201ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
32832025-08-01T16:02:50.201ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7c7dce6b-d7ab-42ed-9f57-6f55e8b38e85", "date": "Fri, 01 Aug 2025 16:02:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
32842025-08-01T16:02:50.201ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
32852025-08-01T16:02:50.205ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 445.655963ms iteration = 11 status = {}
32862025-08-01T16:02:50.206ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
32872025-08-01T16:02:50.206ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 518.635565ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
32882025-08-01T16:02:50.207ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "7cdb4845-5acf-48fc-895e-1f5f889d87a6", "date": "Fri, 01 Aug 2025 16:02:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
32892025-08-01T16:02:50.207ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
32902025-08-01T16:02:50.209ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
32912025-08-01T16:02:50.209ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 520.983777ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
32922025-08-01T16:02:50.219ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32932025-08-01T16:02:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32942025-08-01T16:02:50.222ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32952025-08-01T16:02:50.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32962025-08-01T16:02:50.223ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32972025-08-01T16:02:50.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
32982025-08-01T16:02:50.226ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
32992025-08-01T16:02:50.227ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "cf980bfa-b6bd-4657-939e-0b39a76ce335", "date": "Fri, 01 Aug 2025 16:02:49 GMT"} })
33002025-08-01T16:02:50.229ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:491
33012025-08-01T16:02:50.229ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 518.628186ms
33022025-08-01T16:02:50.229ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 518.639706ms iteration = 2 status = {}
33032025-08-01T16:02:50.273ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33042025-08-01T16:02:50.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33052025-08-01T16:02:50.276ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 3f21d9d5-3adf-463a-a05d-bc2e2e5d64ca, rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(4c7da70d-ede0-4107-abc5-5650a053be38) } rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
33062025-08-01T16:02:50.276ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33072025-08-01T16:02:50.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33082025-08-01T16:02:50.287ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
33092025-08-01T16:02:50.287ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 4c7da70d-ede0-4107-abc5-5650a053be38
33102025-08-01T16:02:50.287ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
33112025-08-01T16:02:50.287ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
33122025-08-01T16:02:50.287ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33132025-08-01T16:02:50.287ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33142025-08-01T16:02:50.287ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33152025-08-01T16:02:50.287ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
33162025-08-01T16:02:50.287ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33172025-08-01T16:02:50.287ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
33182025-08-01T16:02:50.288ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
33192025-08-01T16:02:50.288ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33202025-08-01T16:02:50.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33212025-08-01T16:02:50.290ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
33222025-08-01T16:02:50.290ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
33232025-08-01T16:02:50.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1a26c25e-cbfb-4bf3-9a9d-18dee0625096 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33242025-08-01T16:02:50.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1a26c25e-cbfb-4bf3-9a9d-18dee0625096 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33252025-08-01T16:02:50.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2552 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1a26c25e-cbfb-4bf3-9a9d-18dee0625096 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33262025-08-01T16:02:50.400ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d1c6ffe8-2078-42c3-b668-1bf9f1c636e7", "date": "Fri, 01 Aug 2025 16:02:50 GMT"} })
33272025-08-01T16:02:50.400ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch = Switch0
33282025-08-01T16:02:50.400ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
33292025-08-01T16:02:50.407ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcdeb40a-959d-4f8a-b72c-98abd34e57be", "content-length": "682", "date": "Fri, 01 Aug 2025 16:02:49 GMT"} })
33302025-08-01T16:02:50.407ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33312025-08-01T16:02:50.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33322025-08-01T16:02:50.411ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33332025-08-01T16:02:50.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33342025-08-01T16:02:50.414ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33352025-08-01T16:02:50.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33362025-08-01T16:02:50.416ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33372025-08-01T16:02:50.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33382025-08-01T16:02:50.422ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 663.554939ms iteration = 11 status = {}
33392025-08-01T16:02:51.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9576ab93-1fc4-42f3-8744-ccf22292bae1 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33402025-08-01T16:02:51.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9576ab93-1fc4-42f3-8744-ccf22292bae1 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33412025-08-01T16:02:51.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2215 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9576ab93-1fc4-42f3-8744-ccf22292bae1 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33422025-08-01T16:02:52.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 393c739d-fc4b-4345-bcfb-00d87a1df2ab roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33432025-08-01T16:02:52.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 393c739d-fc4b-4345-bcfb-00d87a1df2ab resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33442025-08-01T16:02:52.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2041 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 393c739d-fc4b-4345-bcfb-00d87a1df2ab response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33452025-08-01T16:02:53.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5011f7cd-3860-4b1f-82f6-ab3811e613d6 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33462025-08-01T16:02:53.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5011f7cd-3860-4b1f-82f6-ab3811e613d6 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33472025-08-01T16:02:53.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2329 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5011f7cd-3860-4b1f-82f6-ab3811e613d6 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33482025-08-01T16:02:54.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5d9350c6-62e2-40fa-8abc-55b83afccc8f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33492025-08-01T16:02:54.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5d9350c6-62e2-40fa-8abc-55b83afccc8f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33502025-08-01T16:02:54.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2231 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5d9350c6-62e2-40fa-8abc-55b83afccc8f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33512025-08-01T16:02:54.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 62 reason = Timeout
33522025-08-01T16:02:54.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
33532025-08-01T16:02:54.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
33542025-08-01T16:02:54.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33552025-08-01T16:02:54.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
33562025-08-01T16:02:54.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
33572025-08-01T16:02:54.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
33582025-08-01T16:02:54.767ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
33592025-08-01T16:02:54.767ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.803537ms iteration = 62 status = {"chicken_switches_updated":false}
33602025-08-01T16:02:55.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 599d7796-c1a1-4549-9905-c7b8a124a878 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33612025-08-01T16:02:55.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 599d7796-c1a1-4549-9905-c7b8a124a878 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33622025-08-01T16:02:55.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2710 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 599d7796-c1a1-4549-9905-c7b8a124a878 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33632025-08-01T16:02:56.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1734ce38-8cb2-4839-baed-5efd2452edc7 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33642025-08-01T16:02:56.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1734ce38-8cb2-4839-baed-5efd2452edc7 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33652025-08-01T16:02:56.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2133 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1734ce38-8cb2-4839-baed-5efd2452edc7 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33662025-08-01T16:02:57.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 581d257a-76a8-4937-a7fc-f02136b1feae roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33672025-08-01T16:02:57.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 581d257a-76a8-4937-a7fc-f02136b1feae resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33682025-08-01T16:02:57.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2544 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 581d257a-76a8-4937-a7fc-f02136b1feae response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33692025-08-01T16:02:58.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8117e9d8-7794-4504-8d68-7d222c90031b roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33702025-08-01T16:02:58.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8117e9d8-7794-4504-8d68-7d222c90031b resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33712025-08-01T16:02:58.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2154 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8117e9d8-7794-4504-8d68-7d222c90031b response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33722025-08-01T16:02:59.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ad3fee01-0e46-4c16-a1d5-4c848110b40f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33732025-08-01T16:02:59.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ad3fee01-0e46-4c16-a1d5-4c848110b40f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33742025-08-01T16:02:59.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2268 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ad3fee01-0e46-4c16-a1d5-4c848110b40f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
33752025-08-01T16:02:59.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
33762025-08-01T16:02:59.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 63 reason = Timeout
33772025-08-01T16:02:59.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33782025-08-01T16:02:59.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
33792025-08-01T16:02:59.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33802025-08-01T16:02:59.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
33812025-08-01T16:02:59.760ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
33822025-08-01T16:02:59.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33832025-08-01T16:02:59.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33842025-08-01T16:02:59.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33852025-08-01T16:02:59.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33862025-08-01T16:02:59.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33872025-08-01T16:02:59.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33882025-08-01T16:02:59.763ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.800485ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33892025-08-01T16:02:59.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
33902025-08-01T16:02:59.765ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
33912025-08-01T16:02:59.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
33922025-08-01T16:02:59.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33932025-08-01T16:02:59.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33942025-08-01T16:02:59.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33952025-08-01T16:02:59.767ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
33962025-08-01T16:02:59.767ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.538109ms iteration = 63 status = {"chicken_switches_updated":false}
33972025-08-01T16:02:59.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33982025-08-01T16:02:59.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33992025-08-01T16:02:59.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34002025-08-01T16:02:59.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
34012025-08-01T16:02:59.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34022025-08-01T16:02:59.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34032025-08-01T16:02:59.784ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
34042025-08-01T16:02:59.784ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.678498ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
34052025-08-01T16:02:59.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 587 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 32d69a95-0f50-4834-af76-0a1056f9ebe0 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
34062025-08-01T16:03:00.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2ea9f542-e4a1-4c2f-8b4f-f9b6f85475b4 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34072025-08-01T16:03:00.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2ea9f542-e4a1-4c2f-8b4f-f9b6f85475b4 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34082025-08-01T16:03:00.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2050 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2ea9f542-e4a1-4c2f-8b4f-f9b6f85475b4 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34092025-08-01T16:03:01.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 113d9861-4dd9-4480-a45f-585b2e347db5 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34102025-08-01T16:03:01.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 113d9861-4dd9-4480-a45f-585b2e347db5 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34112025-08-01T16:03:01.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2407 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 113d9861-4dd9-4480-a45f-585b2e347db5 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34122025-08-01T16:03:02.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 97cea926-dc3e-4a42-9216-c1864e4ce247 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34132025-08-01T16:03:02.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 97cea926-dc3e-4a42-9216-c1864e4ce247 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34142025-08-01T16:03:02.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2105 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 97cea926-dc3e-4a42-9216-c1864e4ce247 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34152025-08-01T16:03:03.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7053f5c1-1c59-45a6-8085-320c51c01afe roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34162025-08-01T16:03:03.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7053f5c1-1c59-45a6-8085-320c51c01afe resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34172025-08-01T16:03:03.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2021 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7053f5c1-1c59-45a6-8085-320c51c01afe response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34182025-08-01T16:03:04.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c7fd36b7-d774-4266-b1cc-e0b8c4a7c682 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34192025-08-01T16:03:04.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c7fd36b7-d774-4266-b1cc-e0b8c4a7c682 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34202025-08-01T16:03:04.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2806 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c7fd36b7-d774-4266-b1cc-e0b8c4a7c682 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34212025-08-01T16:03:04.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 64 reason = Timeout
34222025-08-01T16:03:04.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
34232025-08-01T16:03:04.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
34242025-08-01T16:03:04.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34252025-08-01T16:03:04.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
34262025-08-01T16:03:04.765ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
34272025-08-01T16:03:04.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
34282025-08-01T16:03:04.767ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
34292025-08-01T16:03:04.767ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.360833ms iteration = 64 status = {"chicken_switches_updated":false}
34302025-08-01T16:03:05.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c4792f72-ac38-435f-b9ad-7dcc9d5dfa3d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34312025-08-01T16:03:05.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c4792f72-ac38-435f-b9ad-7dcc9d5dfa3d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34322025-08-01T16:03:05.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2361 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c4792f72-ac38-435f-b9ad-7dcc9d5dfa3d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34332025-08-01T16:03:06.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 841c4551-1840-4c02-8284-5cc376b87c7e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34342025-08-01T16:03:06.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 841c4551-1840-4c02-8284-5cc376b87c7e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34352025-08-01T16:03:06.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2539 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 841c4551-1840-4c02-8284-5cc376b87c7e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34362025-08-01T16:03:07.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 27a14e9e-952f-434d-b691-7da0c31c60d9 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34372025-08-01T16:03:07.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 27a14e9e-952f-434d-b691-7da0c31c60d9 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34382025-08-01T16:03:07.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2351 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 27a14e9e-952f-434d-b691-7da0c31c60d9 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34392025-08-01T16:03:08.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7d9a9293-9ecd-43f7-8275-85358fe54ec1 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34402025-08-01T16:03:08.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7d9a9293-9ecd-43f7-8275-85358fe54ec1 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34412025-08-01T16:03:08.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2049 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7d9a9293-9ecd-43f7-8275-85358fe54ec1 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34422025-08-01T16:03:09.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 58eb18db-a8fc-4f5a-a445-fbc21eba38e9 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34432025-08-01T16:03:09.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 58eb18db-a8fc-4f5a-a445-fbc21eba38e9 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34442025-08-01T16:03:09.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2742 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 58eb18db-a8fc-4f5a-a445-fbc21eba38e9 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34452025-08-01T16:03:09.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
34462025-08-01T16:03:09.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34472025-08-01T16:03:09.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 65 reason = Timeout
34482025-08-01T16:03:09.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
34492025-08-01T16:03:09.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34502025-08-01T16:03:09.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
34512025-08-01T16:03:09.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
34522025-08-01T16:03:09.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34532025-08-01T16:03:09.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34542025-08-01T16:03:09.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34552025-08-01T16:03:09.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34562025-08-01T16:03:09.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34572025-08-01T16:03:09.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34582025-08-01T16:03:09.762ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.052393ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34592025-08-01T16:03:09.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
34602025-08-01T16:03:09.765ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
34612025-08-01T16:03:09.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
34622025-08-01T16:03:09.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34632025-08-01T16:03:09.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34642025-08-01T16:03:09.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34652025-08-01T16:03:09.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
34662025-08-01T16:03:09.767ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.389564ms iteration = 65 status = {"chicken_switches_updated":false}
34672025-08-01T16:03:09.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34682025-08-01T16:03:09.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34692025-08-01T16:03:09.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34702025-08-01T16:03:09.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
34712025-08-01T16:03:09.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34722025-08-01T16:03:09.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34732025-08-01T16:03:09.783ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
34742025-08-01T16:03:09.783ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.130072ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
34752025-08-01T16:03:09.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 902 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 6ebc6259-3d47-44cd-8bce-6c82c280dc29 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
34762025-08-01T16:03:10.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e0c9f257-4d0e-446c-8920-256267064000 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34772025-08-01T16:03:10.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e0c9f257-4d0e-446c-8920-256267064000 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34782025-08-01T16:03:10.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1763 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e0c9f257-4d0e-446c-8920-256267064000 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34792025-08-01T16:03:11.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a6533277-6b32-4c44-83f8-937f1a93bdec roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34802025-08-01T16:03:11.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a6533277-6b32-4c44-83f8-937f1a93bdec resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34812025-08-01T16:03:11.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2227 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a6533277-6b32-4c44-83f8-937f1a93bdec response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34822025-08-01T16:03:12.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ccb5f44c-d5c3-49aa-b448-1913df86cb4a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34832025-08-01T16:03:12.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ccb5f44c-d5c3-49aa-b448-1913df86cb4a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34842025-08-01T16:03:12.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2234 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ccb5f44c-d5c3-49aa-b448-1913df86cb4a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34852025-08-01T16:03:13.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7a869b67-f6b3-4bc5-baca-b1e2f6f9f231 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34862025-08-01T16:03:13.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7a869b67-f6b3-4bc5-baca-b1e2f6f9f231 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34872025-08-01T16:03:13.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1991 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7a869b67-f6b3-4bc5-baca-b1e2f6f9f231 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34882025-08-01T16:03:14.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5eb83572-202c-4ba6-9e39-45bbdd2a7617 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34892025-08-01T16:03:14.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5eb83572-202c-4ba6-9e39-45bbdd2a7617 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34902025-08-01T16:03:14.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2350 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5eb83572-202c-4ba6-9e39-45bbdd2a7617 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
34912025-08-01T16:03:14.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 66 reason = Timeout
34922025-08-01T16:03:14.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
34932025-08-01T16:03:14.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
34942025-08-01T16:03:14.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34952025-08-01T16:03:14.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
34962025-08-01T16:03:14.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
34972025-08-01T16:03:14.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
34982025-08-01T16:03:14.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
34992025-08-01T16:03:14.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.191628ms iteration = 66 status = {"chicken_switches_updated":false}
35002025-08-01T16:03:15.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a843d590-5c83-43ac-9f25-0e4872e28a98 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
35012025-08-01T16:03:15.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a843d590-5c83-43ac-9f25-0e4872e28a98 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
35022025-08-01T16:03:15.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2266 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a843d590-5c83-43ac-9f25-0e4872e28a98 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
35032025-08-01T16:03:16.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b39a8711-31d7-4f17-ac76-2eb24a3a9faf roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
35042025-08-01T16:03:16.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b39a8711-31d7-4f17-ac76-2eb24a3a9faf resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
35052025-08-01T16:03:16.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2370 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b39a8711-31d7-4f17-ac76-2eb24a3a9faf response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
35062025-08-01T16:03:17.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bf899078-c7a5-43cb-a3bb-dc74fadd9700 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
35072025-08-01T16:03:17.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bf899078-c7a5-43cb-a3bb-dc74fadd9700 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
35082025-08-01T16:03:17.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2014 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bf899078-c7a5-43cb-a3bb-dc74fadd9700 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
35092025-08-01T16:03:18.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 15cd9acb-945a-4649-9f00-979b2082e420 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
35102025-08-01T16:03:18.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 15cd9acb-945a-4649-9f00-979b2082e420 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
35112025-08-01T16:03:18.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2027 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 15cd9acb-945a-4649-9f00-979b2082e420 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
35122025-08-01T16:03:19.688ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
35132025-08-01T16:03:19.688ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
35142025-08-01T16:03:19.688ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
35152025-08-01T16:03:19.688ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
35162025-08-01T16:03:19.688ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35172025-08-01T16:03:19.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
35182025-08-01T16:03:19.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35192025-08-01T16:03:19.691ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43895, tv_nsec: 707311606 } })
35202025-08-01T16:03:19.691ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
35212025-08-01T16:03:19.691ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43895, tv_nsec: 707763180 } })
35222025-08-01T16:03:19.692ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.357632ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
35232025-08-01T16:03:19.692ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
35242025-08-01T16:03:19.731ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
35252025-08-01T16:03:19.731ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35262025-08-01T16:03:19.731ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0cd32f01-555a-43c9-8d93-078154b96871", "content-length": "26", "date": "Fri, 01 Aug 2025 16:03:19 GMT"} })
35272025-08-01T16:03:19.731ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35282025-08-01T16:03:19.731ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
35292025-08-01T16:03:19.731ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35302025-08-01T16:03:19.731ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a3e02dd-9280-407e-b181-df002d578547", "content-length": "26", "date": "Fri, 01 Aug 2025 16:03:19 GMT"} })
35312025-08-01T16:03:19.732ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35322025-08-01T16:03:19.733ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35332025-08-01T16:03:19.733ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35342025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 12 reason = Timeout
35352025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
35362025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 13.65\u{b5}s iteration = 12 status = {"disabled":true,"errors":[],"sps":[]}
35372025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
35382025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
35392025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35402025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35412025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35422025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
35432025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
35442025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35452025-08-01T16:03:19.759ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
35462025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
35472025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35482025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35492025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
35502025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
35512025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35522025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
35532025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35542025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
35552025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35562025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
35572025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35582025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 67 reason = Timeout
35592025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
35602025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
35612025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35622025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 12 reason = Timeout
35632025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
35642025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
35652025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
35662025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
35672025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
35682025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35692025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 12 reason = Timeout
35702025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
35712025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35722025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
35732025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35742025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35752025-08-01T16:03:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35762025-08-01T16:03:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35772025-08-01T16:03:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35782025-08-01T16:03:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35792025-08-01T16:03:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35802025-08-01T16:03:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35812025-08-01T16:03:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
35822025-08-01T16:03:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
35832025-08-01T16:03:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35842025-08-01T16:03:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35852025-08-01T16:03:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
35862025-08-01T16:03:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
35872025-08-01T16:03:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35882025-08-01T16:03:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
35892025-08-01T16:03:19.761ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35902025-08-01T16:03:19.762ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35912025-08-01T16:03:19.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35922025-08-01T16:03:19.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35932025-08-01T16:03:19.763ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35942025-08-01T16:03:19.763ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35952025-08-01T16:03:19.763ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
35962025-08-01T16:03:19.763ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35972025-08-01T16:03:19.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
35982025-08-01T16:03:19.763ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35992025-08-01T16:03:19.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36002025-08-01T16:03:19.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36012025-08-01T16:03:19.764ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36022025-08-01T16:03:19.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36032025-08-01T16:03:19.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
36042025-08-01T16:03:19.765ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36052025-08-01T16:03:19.766ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36062025-08-01T16:03:19.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36072025-08-01T16:03:19.766ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36082025-08-01T16:03:19.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36092025-08-01T16:03:19.767ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36102025-08-01T16:03:19.767ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.293911ms iteration = 12 status = {"errors":[],"finish_invoked_ok":[]}
36112025-08-01T16:03:19.767ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36122025-08-01T16:03:19.767ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36132025-08-01T16:03:19.768ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36142025-08-01T16:03:19.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36152025-08-01T16:03:19.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36162025-08-01T16:03:19.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
36172025-08-01T16:03:19.770ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36182025-08-01T16:03:19.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36192025-08-01T16:03:19.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36202025-08-01T16:03:19.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36212025-08-01T16:03:19.771ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36222025-08-01T16:03:19.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36232025-08-01T16:03:19.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36242025-08-01T16:03:19.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
36252025-08-01T16:03:19.772ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
36262025-08-01T16:03:19.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
36272025-08-01T16:03:19.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
36282025-08-01T16:03:19.772ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
36292025-08-01T16:03:19.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
36302025-08-01T16:03:19.772ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36312025-08-01T16:03:19.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 527d32cc-fedc-4ade-9192-9d5ece44bb11 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
36322025-08-01T16:03:19.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36332025-08-01T16:03:19.773ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36342025-08-01T16:03:19.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 527d32cc-fedc-4ade-9192-9d5ece44bb11 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
36352025-08-01T16:03:19.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36362025-08-01T16:03:19.773ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43895, tv_nsec: 789367665 } })
36372025-08-01T16:03:19.773ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
36382025-08-01T16:03:19.775ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
36392025-08-01T16:03:19.775ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 15.896602ms iteration = 67 status = {"chicken_switches_updated":false}
36402025-08-01T16:03:19.775ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
36412025-08-01T16:03:19.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
36422025-08-01T16:03:19.776ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 16.611084ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
36432025-08-01T16:03:19.776ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 88.132022ms iteration = 12 status = {}
36442025-08-01T16:03:19.776ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36452025-08-01T16:03:19.777ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36462025-08-01T16:03:19.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36472025-08-01T16:03:19.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 7014 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 527d32cc-fedc-4ade-9192-9d5ece44bb11 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
36482025-08-01T16:03:19.781ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36492025-08-01T16:03:19.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36502025-08-01T16:03:19.782ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36512025-08-01T16:03:19.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36522025-08-01T16:03:19.783ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 94.64607ms iteration = 12 status = null
36532025-08-01T16:03:19.783ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36542025-08-01T16:03:19.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36552025-08-01T16:03:19.784ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
36562025-08-01T16:03:19.784ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
36572025-08-01T16:03:19.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
36582025-08-01T16:03:19.785ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36592025-08-01T16:03:19.786ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:391
36602025-08-01T16:03:19.786ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 26.296968ms iteration = 12 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
36612025-08-01T16:03:19.789ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
36622025-08-01T16:03:19.789ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36632025-08-01T16:03:19.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36642025-08-01T16:03:19.806ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
36652025-08-01T16:03:19.806ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.482539ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
36662025-08-01T16:03:19.808ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36672025-08-01T16:03:19.808ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36682025-08-01T16:03:19.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36692025-08-01T16:03:19.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36702025-08-01T16:03:19.810ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 51.368957ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36712025-08-01T16:03:19.811ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 zone_address = fd00:1122:3344:101::2
36722025-08-01T16:03:19.811ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36732025-08-01T16:03:19.811ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "31f6860d-c140-49d6-a50b-117347430296", "content-length": "26", "date": "Fri, 01 Aug 2025 16:03:19 GMT"} })
36742025-08-01T16:03:19.811ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36752025-08-01T16:03:19.813ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
36762025-08-01T16:03:19.817ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36772025-08-01T16:03:19.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36782025-08-01T16:03:19.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36792025-08-01T16:03:19.820ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36802025-08-01T16:03:19.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36812025-08-01T16:03:19.821ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.915847ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
36822025-08-01T16:03:19.822ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36832025-08-01T16:03:19.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36842025-08-01T16:03:19.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36852025-08-01T16:03:19.822ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36862025-08-01T16:03:19.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
36872025-08-01T16:03:19.827ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36882025-08-01T16:03:19.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36892025-08-01T16:03:19.829ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36902025-08-01T16:03:19.829ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
36912025-08-01T16:03:19.829ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36922025-08-01T16:03:19.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36932025-08-01T16:03:19.830ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 70.550159ms iteration = 12 status = {"errors":[],"requests_created_ok":[]}
36942025-08-01T16:03:19.831ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 71.659903ms iteration = 12 status = 0
36952025-08-01T16:03:19.840ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36962025-08-01T16:03:19.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36972025-08-01T16:03:19.843ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
36982025-08-01T16:03:19.843ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 83.79297ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
36992025-08-01T16:03:19.850ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37002025-08-01T16:03:19.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
37012025-08-01T16:03:19.852ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 93.224357ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
37022025-08-01T16:03:19.880ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 121.196405ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
37032025-08-01T16:03:19.885ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37042025-08-01T16:03:19.885ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
37052025-08-01T16:03:19.885ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 126.350391ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
37062025-08-01T16:03:19.911ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37072025-08-01T16:03:19.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37082025-08-01T16:03:19.913ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37092025-08-01T16:03:19.916ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37102025-08-01T16:03:19.916ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37112025-08-01T16:03:19.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37122025-08-01T16:03:19.917ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37132025-08-01T16:03:19.919ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37142025-08-01T16:03:19.919ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37152025-08-01T16:03:19.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37162025-08-01T16:03:19.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 713 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 47832871-6d1c-42a6-a083-8ce23797a386 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
37172025-08-01T16:03:19.928ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37182025-08-01T16:03:19.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37192025-08-01T16:03:19.930ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 3f21d9d5-3adf-463a-a05d-bc2e2e5d64ca, rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(4c7da70d-ede0-4107-abc5-5650a053be38) } rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
37202025-08-01T16:03:19.930ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37212025-08-01T16:03:19.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37222025-08-01T16:03:19.948ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 189.33413ms iteration = 14 status = {"physical_disks_added":0}
37232025-08-01T16:03:19.952ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
37242025-08-01T16:03:19.952ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 4c7da70d-ede0-4107-abc5-5650a053be38
37252025-08-01T16:03:19.953ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
37262025-08-01T16:03:19.953ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37272025-08-01T16:03:19.953ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37282025-08-01T16:03:19.953ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37292025-08-01T16:03:19.953ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37302025-08-01T16:03:19.953ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37312025-08-01T16:03:19.953ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37322025-08-01T16:03:19.953ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37332025-08-01T16:03:19.953ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
37342025-08-01T16:03:19.953ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37352025-08-01T16:03:19.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37362025-08-01T16:03:19.956ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
37372025-08-01T16:03:19.956ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
37382025-08-01T16:03:19.966ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
37392025-08-01T16:03:19.966ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37402025-08-01T16:03:19.967ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "043dc49f-4944-449a-b433-746b4c6794ed", "content-length": "372", "date": "Fri, 01 Aug 2025 16:03:19 GMT"} })
37412025-08-01T16:03:19.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37422025-08-01T16:03:19.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37432025-08-01T16:03:20.028ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
37442025-08-01T16:03:20.028ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
37452025-08-01T16:03:20.032ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bc5a9657-85d0-4d17-a4fa-b5655866b59c", "date": "Fri, 01 Aug 2025 16:03:19 GMT"} })
37462025-08-01T16:03:20.032ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37472025-08-01T16:03:20.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37482025-08-01T16:03:20.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37492025-08-01T16:03:20.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37502025-08-01T16:03:20.037ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37512025-08-01T16:03:20.037ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4edf2bfc-5889-4362-b717-2301dff45299", "content-length": "691", "date": "Fri, 01 Aug 2025 16:03:19 GMT"} })
37522025-08-01T16:03:20.037ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
37532025-08-01T16:03:20.037ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
37542025-08-01T16:03:20.037ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
37552025-08-01T16:03:20.038ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37562025-08-01T16:03:20.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37572025-08-01T16:03:20.039ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 279.64669ms iteration = 12 status = {}
37582025-08-01T16:03:20.042ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
37592025-08-01T16:03:20.042ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37602025-08-01T16:03:20.048ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cb339f40-acb9-4c5c-9bb2-1666aeb7ac54", "date": "Fri, 01 Aug 2025 16:03:19 GMT"} })
37612025-08-01T16:03:20.049ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 290.409685ms iteration = 12 status = {}
37622025-08-01T16:03:20.086ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "fc86b57d-7f89-4be7-acec-eda578aba23a", "date": "Fri, 01 Aug 2025 16:03:19 GMT"} })
37632025-08-01T16:03:20.086ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch = Switch0
37642025-08-01T16:03:20.086ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
37652025-08-01T16:03:20.093ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0af1f894-aeab-45b4-885e-09115634f362", "content-length": "682", "date": "Fri, 01 Aug 2025 16:03:19 GMT"} })
37662025-08-01T16:03:20.093ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37672025-08-01T16:03:20.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37682025-08-01T16:03:20.098ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37692025-08-01T16:03:20.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37702025-08-01T16:03:20.100ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37712025-08-01T16:03:20.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37722025-08-01T16:03:20.102ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37732025-08-01T16:03:20.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37742025-08-01T16:03:20.109ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 350.077395ms iteration = 12 status = {}
37752025-08-01T16:03:20.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f54cc753-835f-4081-9b15-d10b6fd08f9a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
37762025-08-01T16:03:20.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f54cc753-835f-4081-9b15-d10b6fd08f9a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
37772025-08-01T16:03:20.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2202 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f54cc753-835f-4081-9b15-d10b6fd08f9a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
37782025-08-01T16:03:21.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4864aefb-8aa5-4749-976a-954dad9f1095 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
37792025-08-01T16:03:21.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4864aefb-8aa5-4749-976a-954dad9f1095 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
37802025-08-01T16:03:21.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2213 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4864aefb-8aa5-4749-976a-954dad9f1095 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
37812025-08-01T16:03:22.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = db9161aa-6b4c-406f-acd6-c2473a992395 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
37822025-08-01T16:03:22.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = db9161aa-6b4c-406f-acd6-c2473a992395 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
37832025-08-01T16:03:22.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2227 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = db9161aa-6b4c-406f-acd6-c2473a992395 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
37842025-08-01T16:03:23.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e7f8fb44-5b29-435e-be6a-288b050e7138 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
37852025-08-01T16:03:23.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e7f8fb44-5b29-435e-be6a-288b050e7138 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
37862025-08-01T16:03:23.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2210 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e7f8fb44-5b29-435e-be6a-288b050e7138 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
37872025-08-01T16:03:24.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 68 reason = Timeout
37882025-08-01T16:03:24.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
37892025-08-01T16:03:24.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
37902025-08-01T16:03:24.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37912025-08-01T16:03:24.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
37922025-08-01T16:03:24.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
37932025-08-01T16:03:24.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
37942025-08-01T16:03:24.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
37952025-08-01T16:03:24.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.874619ms iteration = 68 status = {"chicken_switches_updated":false}
37962025-08-01T16:03:24.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3c69a9d6-b4a8-4f0f-b0f5-9426fde49d6d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
37972025-08-01T16:03:24.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3c69a9d6-b4a8-4f0f-b0f5-9426fde49d6d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
37982025-08-01T16:03:24.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2289 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3c69a9d6-b4a8-4f0f-b0f5-9426fde49d6d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
37992025-08-01T16:03:25.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 30b653a0-465f-4154-b2fa-619020b822f3 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38002025-08-01T16:03:25.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 30b653a0-465f-4154-b2fa-619020b822f3 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38012025-08-01T16:03:25.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2280 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 30b653a0-465f-4154-b2fa-619020b822f3 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38022025-08-01T16:03:26.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9ea6f227-565a-4264-81d9-79a7cb277439 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38032025-08-01T16:03:26.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9ea6f227-565a-4264-81d9-79a7cb277439 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38042025-08-01T16:03:26.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1854 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9ea6f227-565a-4264-81d9-79a7cb277439 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38052025-08-01T16:03:27.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6e75c1e2-a8bd-487c-9b86-d1c4494781b6 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38062025-08-01T16:03:27.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6e75c1e2-a8bd-487c-9b86-d1c4494781b6 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38072025-08-01T16:03:27.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1732 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6e75c1e2-a8bd-487c-9b86-d1c4494781b6 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38082025-08-01T16:03:28.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 369670b3-74fe-435f-9b47-7c9807de2cf2 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38092025-08-01T16:03:28.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 369670b3-74fe-435f-9b47-7c9807de2cf2 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38102025-08-01T16:03:28.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2420 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 369670b3-74fe-435f-9b47-7c9807de2cf2 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38112025-08-01T16:03:29.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
38122025-08-01T16:03:29.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38132025-08-01T16:03:29.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 69 reason = Timeout
38142025-08-01T16:03:29.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
38152025-08-01T16:03:29.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38162025-08-01T16:03:29.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
38172025-08-01T16:03:29.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
38182025-08-01T16:03:29.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38192025-08-01T16:03:29.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38202025-08-01T16:03:29.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38212025-08-01T16:03:29.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38222025-08-01T16:03:29.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38232025-08-01T16:03:29.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38242025-08-01T16:03:29.763ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.031203ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38252025-08-01T16:03:29.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
38262025-08-01T16:03:29.766ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
38272025-08-01T16:03:29.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38282025-08-01T16:03:29.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38292025-08-01T16:03:29.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
38302025-08-01T16:03:29.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38312025-08-01T16:03:29.767ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
38322025-08-01T16:03:29.767ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.608692ms iteration = 69 status = {"chicken_switches_updated":false}
38332025-08-01T16:03:29.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38342025-08-01T16:03:29.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38352025-08-01T16:03:29.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38362025-08-01T16:03:29.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
38372025-08-01T16:03:29.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38382025-08-01T16:03:29.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38392025-08-01T16:03:29.785ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
38402025-08-01T16:03:29.785ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.912656ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
38412025-08-01T16:03:29.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 645 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = db542716-e4eb-4914-8d60-e38bc7a66f15 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
38422025-08-01T16:03:29.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a90ebd2c-cfaa-4dc7-94e2-d2b4fe05cf77 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38432025-08-01T16:03:29.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a90ebd2c-cfaa-4dc7-94e2-d2b4fe05cf77 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38442025-08-01T16:03:29.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1998 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a90ebd2c-cfaa-4dc7-94e2-d2b4fe05cf77 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38452025-08-01T16:03:30.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2bb3f386-74b3-4979-a4f4-994d0ac26f53 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38462025-08-01T16:03:30.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2bb3f386-74b3-4979-a4f4-994d0ac26f53 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38472025-08-01T16:03:30.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1942 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2bb3f386-74b3-4979-a4f4-994d0ac26f53 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38482025-08-01T16:03:31.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 763db33c-d57d-4ba8-bb62-aa37ef904981 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38492025-08-01T16:03:31.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 763db33c-d57d-4ba8-bb62-aa37ef904981 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38502025-08-01T16:03:31.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1800 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 763db33c-d57d-4ba8-bb62-aa37ef904981 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38512025-08-01T16:03:32.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8a34f09f-a6e3-4eb5-a3da-b4f395692235 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38522025-08-01T16:03:32.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8a34f09f-a6e3-4eb5-a3da-b4f395692235 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38532025-08-01T16:03:32.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2303 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8a34f09f-a6e3-4eb5-a3da-b4f395692235 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38542025-08-01T16:03:34.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ed3f35ec-879b-463f-a90c-c624a698b1c2 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38552025-08-01T16:03:34.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ed3f35ec-879b-463f-a90c-c624a698b1c2 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38562025-08-01T16:03:34.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2521 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ed3f35ec-879b-463f-a90c-c624a698b1c2 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38572025-08-01T16:03:34.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 70 reason = Timeout
38582025-08-01T16:03:34.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
38592025-08-01T16:03:34.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
38602025-08-01T16:03:34.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38612025-08-01T16:03:34.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
38622025-08-01T16:03:34.765ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
38632025-08-01T16:03:34.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
38642025-08-01T16:03:34.767ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
38652025-08-01T16:03:34.767ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.648662ms iteration = 70 status = {"chicken_switches_updated":false}
38662025-08-01T16:03:35.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = eea7e1a0-b52a-4a07-9d48-768b08e72311 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38672025-08-01T16:03:35.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = eea7e1a0-b52a-4a07-9d48-768b08e72311 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38682025-08-01T16:03:35.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2489 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = eea7e1a0-b52a-4a07-9d48-768b08e72311 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38692025-08-01T16:03:36.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3ebdf7dd-a178-47af-8319-ab0ac0a8a112 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38702025-08-01T16:03:36.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3ebdf7dd-a178-47af-8319-ab0ac0a8a112 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38712025-08-01T16:03:36.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2407 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3ebdf7dd-a178-47af-8319-ab0ac0a8a112 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38722025-08-01T16:03:37.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = aab6568b-5020-4fcb-841c-9d18220cbfc9 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38732025-08-01T16:03:37.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = aab6568b-5020-4fcb-841c-9d18220cbfc9 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38742025-08-01T16:03:37.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2172 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = aab6568b-5020-4fcb-841c-9d18220cbfc9 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38752025-08-01T16:03:38.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = abb2e58e-dfa4-40fa-beb8-2e1ed7829552 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38762025-08-01T16:03:38.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = abb2e58e-dfa4-40fa-beb8-2e1ed7829552 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38772025-08-01T16:03:38.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2404 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = abb2e58e-dfa4-40fa-beb8-2e1ed7829552 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38782025-08-01T16:03:39.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5d19b0a1-6a85-4045-978d-6e6b6d83d8fb roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38792025-08-01T16:03:39.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5d19b0a1-6a85-4045-978d-6e6b6d83d8fb resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38802025-08-01T16:03:39.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2730 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5d19b0a1-6a85-4045-978d-6e6b6d83d8fb response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
38812025-08-01T16:03:39.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
38822025-08-01T16:03:39.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 71 reason = Timeout
38832025-08-01T16:03:39.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38842025-08-01T16:03:39.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
38852025-08-01T16:03:39.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
38862025-08-01T16:03:39.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38872025-08-01T16:03:39.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38882025-08-01T16:03:39.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
38892025-08-01T16:03:39.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38902025-08-01T16:03:39.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38912025-08-01T16:03:39.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38922025-08-01T16:03:39.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38932025-08-01T16:03:39.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38942025-08-01T16:03:39.763ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.588399ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38952025-08-01T16:03:39.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
38962025-08-01T16:03:39.765ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
38972025-08-01T16:03:39.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
38982025-08-01T16:03:39.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38992025-08-01T16:03:39.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39002025-08-01T16:03:39.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39012025-08-01T16:03:39.767ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
39022025-08-01T16:03:39.767ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.56002ms iteration = 71 status = {"chicken_switches_updated":false}
39032025-08-01T16:03:39.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39042025-08-01T16:03:39.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39052025-08-01T16:03:39.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39062025-08-01T16:03:39.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
39072025-08-01T16:03:39.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39082025-08-01T16:03:39.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39092025-08-01T16:03:39.787ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
39102025-08-01T16:03:39.787ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.186295ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
39112025-08-01T16:03:39.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 677 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = e2e7797c-9fcc-448a-aecc-7c629993bc66 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
39122025-08-01T16:03:40.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 908cf52b-33af-42c4-8bf1-7dd0ac310dc1 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39132025-08-01T16:03:40.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 908cf52b-33af-42c4-8bf1-7dd0ac310dc1 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39142025-08-01T16:03:40.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2165 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 908cf52b-33af-42c4-8bf1-7dd0ac310dc1 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39152025-08-01T16:03:41.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4b8e05af-df89-4077-942a-64fe3abd6dab roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39162025-08-01T16:03:41.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4b8e05af-df89-4077-942a-64fe3abd6dab resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39172025-08-01T16:03:41.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2016 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4b8e05af-df89-4077-942a-64fe3abd6dab response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39182025-08-01T16:03:42.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7893526d-522e-485e-8f2e-66392bdb9222 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39192025-08-01T16:03:42.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7893526d-522e-485e-8f2e-66392bdb9222 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39202025-08-01T16:03:42.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2539 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7893526d-522e-485e-8f2e-66392bdb9222 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39212025-08-01T16:03:43.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e516da7a-7e79-4d7b-b710-5da7545868dd roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39222025-08-01T16:03:43.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e516da7a-7e79-4d7b-b710-5da7545868dd resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39232025-08-01T16:03:43.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2656 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e516da7a-7e79-4d7b-b710-5da7545868dd response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39242025-08-01T16:03:44.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5d12ffd7-a624-487b-8ed7-826cd16ac89a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39252025-08-01T16:03:44.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5d12ffd7-a624-487b-8ed7-826cd16ac89a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39262025-08-01T16:03:44.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2577 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5d12ffd7-a624-487b-8ed7-826cd16ac89a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39272025-08-01T16:03:44.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 72 reason = Timeout
39282025-08-01T16:03:44.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
39292025-08-01T16:03:44.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
39302025-08-01T16:03:44.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39312025-08-01T16:03:44.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
39322025-08-01T16:03:44.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
39332025-08-01T16:03:44.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
39342025-08-01T16:03:44.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
39352025-08-01T16:03:44.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.930171ms iteration = 72 status = {"chicken_switches_updated":false}
39362025-08-01T16:03:45.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3681b7de-dfbf-4df0-9f8e-6ea7563081a3 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39372025-08-01T16:03:45.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3681b7de-dfbf-4df0-9f8e-6ea7563081a3 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39382025-08-01T16:03:45.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2417 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3681b7de-dfbf-4df0-9f8e-6ea7563081a3 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39392025-08-01T16:03:46.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 78036d49-a1c2-4263-9c19-0774e62ad41d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39402025-08-01T16:03:46.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 78036d49-a1c2-4263-9c19-0774e62ad41d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39412025-08-01T16:03:46.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2541 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 78036d49-a1c2-4263-9c19-0774e62ad41d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39422025-08-01T16:03:47.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = eeb50c8b-0081-4637-9cee-c0619dc4d8be roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39432025-08-01T16:03:47.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = eeb50c8b-0081-4637-9cee-c0619dc4d8be resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39442025-08-01T16:03:47.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2268 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = eeb50c8b-0081-4637-9cee-c0619dc4d8be response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39452025-08-01T16:03:48.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 655c2faf-139e-4c1f-93c1-81e8273da8a7 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39462025-08-01T16:03:48.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 655c2faf-139e-4c1f-93c1-81e8273da8a7 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39472025-08-01T16:03:48.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1955 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 655c2faf-139e-4c1f-93c1-81e8273da8a7 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39482025-08-01T16:03:49.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 42f29605-0a76-49d7-bbad-0a04be0be8a8 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39492025-08-01T16:03:49.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 42f29605-0a76-49d7-bbad-0a04be0be8a8 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39502025-08-01T16:03:49.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3214 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 42f29605-0a76-49d7-bbad-0a04be0be8a8 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
39512025-08-01T16:03:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
39522025-08-01T16:03:49.688ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
39532025-08-01T16:03:49.688ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
39542025-08-01T16:03:49.688ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39552025-08-01T16:03:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
39562025-08-01T16:03:49.688ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
39572025-08-01T16:03:49.688ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
39582025-08-01T16:03:49.688ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
39592025-08-01T16:03:49.688ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-01 15:53:49.688708806 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
39602025-08-01T16:03:49.688ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
39612025-08-01T16:03:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
39622025-08-01T16:03:49.688ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
39632025-08-01T16:03:49.688ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39642025-08-01T16:03:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
39652025-08-01T16:03:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
39662025-08-01T16:03:49.688ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
39672025-08-01T16:03:49.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39682025-08-01T16:03:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
39692025-08-01T16:03:49.688ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
39702025-08-01T16:03:49.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39712025-08-01T16:03:49.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39722025-08-01T16:03:49.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
39732025-08-01T16:03:49.689ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cb706a84-a33b-442f-aac2-3a6eb5f3b330.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d688a68d-d771-4ac5-8e66-9efa94dbbea8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d688a68d-d771-4ac5-8e66-9efa94dbbea8.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 43925, tv_nsec: 705159274 } })
39742025-08-01T16:03:49.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39752025-08-01T16:03:49.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39762025-08-01T16:03:49.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39772025-08-01T16:03:49.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39782025-08-01T16:03:49.689ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50fe31de-3241-42df-a386-de37ce323a34.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("58598327-8751-423c-a5ac-c610829651e2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 43925, tv_nsec: 705299739 } })
39792025-08-01T16:03:49.689ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
39802025-08-01T16:03:49.689ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.043131ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
39812025-08-01T16:03:49.689ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
39822025-08-01T16:03:49.689ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.097793ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
39832025-08-01T16:03:49.690ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-01 15:53:49.688708806 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
39842025-08-01T16:03:49.690ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 1.806014ms iteration = 7 status = {"expiration":"2025-08-01T15:53:49.688708806Z","pruned":[]}
39852025-08-01T16:03:49.691ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39862025-08-01T16:03:49.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39872025-08-01T16:03:49.691ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39882025-08-01T16:03:49.691ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39892025-08-01T16:03:49.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39902025-08-01T16:03:49.692ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43925, tv_nsec: 708513976 } })
39912025-08-01T16:03:49.692ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.044313ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39922025-08-01T16:03:49.692ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
39932025-08-01T16:03:49.693ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43925, tv_nsec: 709028172 } })
39942025-08-01T16:03:49.693ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
39952025-08-01T16:03:49.693ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39962025-08-01T16:03:49.694ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39972025-08-01T16:03:49.694ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
39982025-08-01T16:03:49.694ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39992025-08-01T16:03:49.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40002025-08-01T16:03:49.696ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40012025-08-01T16:03:49.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40022025-08-01T16:03:49.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40032025-08-01T16:03:49.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40042025-08-01T16:03:49.698ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40052025-08-01T16:03:49.699ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
40062025-08-01T16:03:49.699ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
40072025-08-01T16:03:49.699ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
40082025-08-01T16:03:49.699ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40092025-08-01T16:03:49.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40102025-08-01T16:03:49.701ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40112025-08-01T16:03:49.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
40122025-08-01T16:03:49.702ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40132025-08-01T16:03:49.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40142025-08-01T16:03:49.705ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40152025-08-01T16:03:49.705ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40162025-08-01T16:03:49.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40172025-08-01T16:03:49.707ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
40182025-08-01T16:03:49.707ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1
40192025-08-01T16:03:49.707ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.951\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1"}
40202025-08-01T16:03:49.710ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
40212025-08-01T16:03:49.710ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40222025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40232025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40242025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40252025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40262025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40272025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40282025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40292025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40302025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40312025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
40322025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 02fcb774-aa43-4052-9996-b85e2d1358b5 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
40332025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 10 reason = Timeout
40342025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
40352025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 8.921\u{b5}s iteration = 10 status = "Disabled"
40362025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40372025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
40382025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
40392025-08-01T16:03:49.712ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
40402025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
40412025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
40422025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 7 reason = Timeout
40432025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
40442025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
40452025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
40462025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 7 reason = Timeout
40472025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
40482025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
40492025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
40502025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
40512025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
40522025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
40532025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
40542025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
40552025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40562025-08-01T16:03:49.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
40572025-08-01T16:03:49.716ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40582025-08-01T16:03:49.719ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.044174ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
40592025-08-01T16:03:49.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40602025-08-01T16:03:49.720ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40612025-08-01T16:03:49.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40622025-08-01T16:03:49.720ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40632025-08-01T16:03:49.724ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40642025-08-01T16:03:49.724ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40652025-08-01T16:03:49.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40662025-08-01T16:03:49.724ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40672025-08-01T16:03:49.726ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
40682025-08-01T16:03:49.726ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
40692025-08-01T16:03:49.726ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 14.51103ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
40702025-08-01T16:03:49.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40712025-08-01T16:03:49.727ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40722025-08-01T16:03:49.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40732025-08-01T16:03:49.728ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40742025-08-01T16:03:49.729ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
40752025-08-01T16:03:49.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
40762025-08-01T16:03:49.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40772025-08-01T16:03:49.731ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40782025-08-01T16:03:49.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40792025-08-01T16:03:49.731ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
40802025-08-01T16:03:49.731ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 19.728318ms iteration = 7 status = {"by_rx":{},"error":null}
40812025-08-01T16:03:49.735ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 23.257216ms iteration = 7 status = {"dispatched":[],"errors":[],"glob_version":"173.0.0","globs_reprocessed":{},"no_receivers":[]}
40822025-08-01T16:03:49.754ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
40832025-08-01T16:03:49.754ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
40842025-08-01T16:03:49.754ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
40852025-08-01T16:03:49.754ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40862025-08-01T16:03:49.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40872025-08-01T16:03:49.757ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40882025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 13 reason = Timeout
40892025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
40902025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 14.94\u{b5}s iteration = 13 status = {"disabled":true,"errors":[],"sps":[]}
40912025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
40922025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40932025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
40942025-08-01T16:03:49.759ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
40952025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40962025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 13 reason = Timeout
40972025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
40982025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40992025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
41002025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41012025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 73 reason = Timeout
41022025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
41032025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
41042025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41052025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
41062025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
41072025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
41082025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41092025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
41102025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
41112025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
41122025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41132025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
41142025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
41152025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41162025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41172025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
41182025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41192025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
41202025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
41212025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41222025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41232025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41242025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 13 reason = Timeout
41252025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
41262025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
41272025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41282025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41292025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41302025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
41312025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41322025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
41332025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
41342025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41352025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41362025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41372025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41382025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41392025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
41402025-08-01T16:03:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41412025-08-01T16:03:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41422025-08-01T16:03:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
41432025-08-01T16:03:49.761ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41442025-08-01T16:03:49.761ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41452025-08-01T16:03:49.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41462025-08-01T16:03:49.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41472025-08-01T16:03:49.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41482025-08-01T16:03:49.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41492025-08-01T16:03:49.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41502025-08-01T16:03:49.762ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41512025-08-01T16:03:49.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41522025-08-01T16:03:49.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
41532025-08-01T16:03:49.765ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41542025-08-01T16:03:49.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41552025-08-01T16:03:49.766ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41562025-08-01T16:03:49.768ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41572025-08-01T16:03:49.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41582025-08-01T16:03:49.768ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41592025-08-01T16:03:49.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
41602025-08-01T16:03:49.768ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
41612025-08-01T16:03:49.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
41622025-08-01T16:03:49.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41632025-08-01T16:03:49.769ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41642025-08-01T16:03:49.769ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41652025-08-01T16:03:49.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41662025-08-01T16:03:49.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
41672025-08-01T16:03:49.770ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41682025-08-01T16:03:49.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41692025-08-01T16:03:49.771ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41702025-08-01T16:03:49.772ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43925, tv_nsec: 788602405 } })
41712025-08-01T16:03:49.773ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
41722025-08-01T16:03:49.773ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41732025-08-01T16:03:49.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
41742025-08-01T16:03:49.774ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
41752025-08-01T16:03:49.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
41762025-08-01T16:03:49.775ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
41772025-08-01T16:03:49.775ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41782025-08-01T16:03:49.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41792025-08-01T16:03:49.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41802025-08-01T16:03:49.776ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41812025-08-01T16:03:49.776ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41822025-08-01T16:03:49.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41832025-08-01T16:03:49.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41842025-08-01T16:03:49.783ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
41852025-08-01T16:03:49.783ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 24.39711ms iteration = 73 status = {"chicken_switches_updated":false}
41862025-08-01T16:03:49.784ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 25.173864ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
41872025-08-01T16:03:49.789ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41882025-08-01T16:03:49.792ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41892025-08-01T16:03:49.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41902025-08-01T16:03:49.794ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41912025-08-01T16:03:49.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41922025-08-01T16:03:49.796ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 85.42759ms iteration = 4 status = {"nsuccess":5}
41932025-08-01T16:03:49.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
41942025-08-01T16:03:49.800ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
41952025-08-01T16:03:49.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
41962025-08-01T16:03:49.801ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 02fcb774-aa43-4052-9996-b85e2d1358b5 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
41972025-08-01T16:03:49.801ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
41982025-08-01T16:03:49.801ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-01 15:58:34.032744 UTC dns_group = internal generation = 1
41992025-08-01T16:03:49.801ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 112.977526ms iteration = 7 status = {"generation":1}
42002025-08-01T16:03:49.825ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
42012025-08-01T16:03:49.832ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 73.362015ms iteration = 13 status = {"errors":[],"finish_invoked_ok":[]}
42022025-08-01T16:03:49.834ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
42032025-08-01T16:03:49.834ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42042025-08-01T16:03:49.834ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "413924f1-bef1-46be-9327-ea40ba4ebe97", "content-length": "26", "date": "Fri, 01 Aug 2025 16:03:49 GMT"} })
42052025-08-01T16:03:49.834ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42062025-08-01T16:03:49.835ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 76.037375ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42072025-08-01T16:03:49.836ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42082025-08-01T16:03:49.836ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42092025-08-01T16:03:49.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42102025-08-01T16:03:49.838ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 79.001865ms iteration = 13 status = {"errors":[],"requests_created_ok":[]}
42112025-08-01T16:03:49.840ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
42122025-08-01T16:03:49.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
42132025-08-01T16:03:49.840ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42142025-08-01T16:03:49.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42152025-08-01T16:03:49.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42162025-08-01T16:03:49.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42172025-08-01T16:03:49.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42182025-08-01T16:03:49.844ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
42192025-08-01T16:03:49.844ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6482e44c-c860-4033-b945-5707d343a59d dns_zone_name = oxide.test found_so_far = 0 version = 2
42202025-08-01T16:03:49.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42212025-08-01T16:03:49.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42222025-08-01T16:03:49.845ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42232025-08-01T16:03:49.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 89.0715ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
42242025-08-01T16:03:49.849ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42252025-08-01T16:03:49.849ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42262025-08-01T16:03:49.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42272025-08-01T16:03:49.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42282025-08-01T16:03:49.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42292025-08-01T16:03:49.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42302025-08-01T16:03:49.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42312025-08-01T16:03:49.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42322025-08-01T16:03:49.856ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42332025-08-01T16:03:49.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42342025-08-01T16:03:49.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42352025-08-01T16:03:49.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42362025-08-01T16:03:49.864ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42372025-08-01T16:03:49.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 106.2079ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
42382025-08-01T16:03:49.868ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42392025-08-01T16:03:49.868ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
42402025-08-01T16:03:49.868ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42412025-08-01T16:03:49.868ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
42422025-08-01T16:03:49.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42432025-08-01T16:03:49.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
42442025-08-01T16:03:49.868ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42452025-08-01T16:03:49.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
42462025-08-01T16:03:49.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42472025-08-01T16:03:49.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
42482025-08-01T16:03:49.869ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42492025-08-01T16:03:49.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42502025-08-01T16:03:49.873ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-01T15:57:44.766264Z, time_modified: 2025-08-01T15:57:44.766264Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: eec17da7-eb17-4917-8728-908698b69bbe, db_silo: Silo { identity: SiloIdentity { id: eec17da7-eb17-4917-8728-908698b69bbe, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-01T15:58:34.653875Z, time_modified: 2025-08-01T15:58:34.653875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: eec17da7-eb17-4917-8728-908698b69bbe, db_silo: Silo { identity: SiloIdentity { id: eec17da7-eb17-4917-8728-908698b69bbe, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-01T15:58:34.653875Z, time_modified: 2025-08-01T15:58:34.653875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575" }] }) }
42512025-08-01T16:03:49.873ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 185.191885ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"eec17da7-eb17-4917-8728-908698b69bbe","tls_certs":["b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575"]}},"default_endpoint":{"silo_id":"eec17da7-eb17-4917-8728-908698b69bbe","tls_certs":["b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
42522025-08-01T16:03:49.875ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42532025-08-01T16:03:49.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
42542025-08-01T16:03:49.878ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
42552025-08-01T16:03:49.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
42562025-08-01T16:03:49.879ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42572025-08-01T16:03:49.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42582025-08-01T16:03:49.889ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
42592025-08-01T16:03:49.889ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
42602025-08-01T16:03:49.889ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 177.076139ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
42612025-08-01T16:03:49.896ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42622025-08-01T16:03:49.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42632025-08-01T16:03:49.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42642025-08-01T16:03:49.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42652025-08-01T16:03:49.900ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
42662025-08-01T16:03:49.900ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 140.431758ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
42672025-08-01T16:03:49.902ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42682025-08-01T16:03:49.904ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
42692025-08-01T16:03:49.904ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42702025-08-01T16:03:49.904ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c423e5b-c29f-4c2a-97f2-3fda62f2c1ad", "content-length": "26", "date": "Fri, 01 Aug 2025 16:03:49 GMT"} })
42712025-08-01T16:03:49.904ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42722025-08-01T16:03:49.907ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42732025-08-01T16:03:49.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
42742025-08-01T16:03:49.907ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42752025-08-01T16:03:49.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42762025-08-01T16:03:49.911ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 151.940887ms iteration = 13 status = 0
42772025-08-01T16:03:49.917ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42782025-08-01T16:03:49.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 770 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 054b4760-60bd-4f39-b6fa-0c0724d85504 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
42792025-08-01T16:03:49.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42802025-08-01T16:03:49.923ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42812025-08-01T16:03:49.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42822025-08-01T16:03:49.925ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
42832025-08-01T16:03:49.925ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 166.193319ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
42842025-08-01T16:03:49.926ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6482e44c-c860-4033-b945-5707d343a59d dns_zone_name = oxide.test found_so_far = 4 version = 2
42852025-08-01T16:03:49.926ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
42862025-08-01T16:03:49.926ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-01 15:58:34.713515 UTC dns_group = external generation = 2
42872025-08-01T16:03:49.926ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 237.853332ms iteration = 7 status = {"generation":2}
42882025-08-01T16:03:49.937ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 zone_address = fd00:1122:3344:101::2
42892025-08-01T16:03:49.937ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42902025-08-01T16:03:49.939ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "830d1f46-8ccf-4ef7-bd39-5baafc025616", "content-length": "26", "date": "Fri, 01 Aug 2025 16:03:49 GMT"} })
42912025-08-01T16:03:49.939ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42922025-08-01T16:03:49.941ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
42932025-08-01T16:03:49.958ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 198.880711ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
42942025-08-01T16:03:49.963ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
42952025-08-01T16:03:49.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
42962025-08-01T16:03:49.966ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42972025-08-01T16:03:49.966ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:391
42982025-08-01T16:03:49.966ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 206.941654ms iteration = 13 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
42992025-08-01T16:03:49.969ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43002025-08-01T16:03:49.969ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43012025-08-01T16:03:49.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43022025-08-01T16:03:49.971ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43032025-08-01T16:03:49.971ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
43042025-08-01T16:03:49.971ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43052025-08-01T16:03:49.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43062025-08-01T16:03:49.979ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43072025-08-01T16:03:49.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43082025-08-01T16:03:50.027ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43092025-08-01T16:03:50.027ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
43102025-08-01T16:03:50.027ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 268.081979ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
43112025-08-01T16:03:50.056ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
43122025-08-01T16:03:50.056ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "205e3790-e5ed-4055-8976-796a3a08c76c", "date": "Fri, 01 Aug 2025 16:03:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
43132025-08-01T16:03:50.056ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
43142025-08-01T16:03:50.058ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "df2a5e71-81fa-4ed3-9c36-b4e43c90d1d9", "date": "Fri, 01 Aug 2025 16:03:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
43152025-08-01T16:03:50.058ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
43162025-08-01T16:03:50.063ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
43172025-08-01T16:03:50.063ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 374.872956ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
43182025-08-01T16:03:50.065ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 376.899978ms iteration = 13 status = {}
43192025-08-01T16:03:50.102ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 343.180916ms iteration = 15 status = {"physical_disks_added":0}
43202025-08-01T16:03:50.107ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
43212025-08-01T16:03:50.107ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 395.672547ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
43222025-08-01T16:03:50.135ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43232025-08-01T16:03:50.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43242025-08-01T16:03:50.137ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43252025-08-01T16:03:50.139ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43262025-08-01T16:03:50.139ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43272025-08-01T16:03:50.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43282025-08-01T16:03:50.141ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43292025-08-01T16:03:50.143ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43302025-08-01T16:03:50.143ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43312025-08-01T16:03:50.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43322025-08-01T16:03:50.175ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
43332025-08-01T16:03:50.183ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43342025-08-01T16:03:50.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43352025-08-01T16:03:50.185ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 496.99702ms iteration = 13 status = null
43362025-08-01T16:03:50.230ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
43372025-08-01T16:03:50.230ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43382025-08-01T16:03:50.231ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "29275ccf-1ec9-45f6-b3d2-d7571a622dd8", "content-length": "372", "date": "Fri, 01 Aug 2025 16:03:49 GMT"} })
43392025-08-01T16:03:50.231ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43402025-08-01T16:03:50.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43412025-08-01T16:03:50.260ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
43422025-08-01T16:03:50.260ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "444c183b-6bc0-4290-8236-45147f094403", "content-length": "691", "date": "Fri, 01 Aug 2025 16:03:49 GMT"} })
43432025-08-01T16:03:50.261ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
43442025-08-01T16:03:50.261ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
43452025-08-01T16:03:50.261ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
43462025-08-01T16:03:50.263ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 503.859197ms iteration = 13 status = {}
43472025-08-01T16:03:50.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b8a3f093-f5e0-4f3e-ad66-36525dffefa9 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
43482025-08-01T16:03:50.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b8a3f093-f5e0-4f3e-ad66-36525dffefa9 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
43492025-08-01T16:03:50.272ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
43502025-08-01T16:03:50.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 4624 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b8a3f093-f5e0-4f3e-ad66-36525dffefa9 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
43512025-08-01T16:03:50.273ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e042a0e2-f142-40fe-bc56-b00ac7d92d1f", "date": "Fri, 01 Aug 2025 16:03:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43522025-08-01T16:03:50.274ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43532025-08-01T16:03:50.276ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e3c2e958-6dd9-4f64-9a76-13b9b2b10a3d", "date": "Fri, 01 Aug 2025 16:03:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43542025-08-01T16:03:50.276ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43552025-08-01T16:03:50.278ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "ad581ed7-bd3e-44e6-a0f5-82d8987e0bff", "date": "Fri, 01 Aug 2025 16:03:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43562025-08-01T16:03:50.278ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43572025-08-01T16:03:50.279ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43582025-08-01T16:03:50.280ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 591.115953ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
43592025-08-01T16:03:50.284ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
43602025-08-01T16:03:50.284ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
43612025-08-01T16:03:50.285ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3a658a1a-1644-4147-b9ba-619cd0132c58", "date": "Fri, 01 Aug 2025 16:03:49 GMT"} })
43622025-08-01T16:03:50.285ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43632025-08-01T16:03:50.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43642025-08-01T16:03:50.287ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43652025-08-01T16:03:50.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43662025-08-01T16:03:50.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43672025-08-01T16:03:50.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43682025-08-01T16:03:50.294ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
43692025-08-01T16:03:50.294ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43702025-08-01T16:03:50.298ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9d204f12-b65a-4eca-bfc9-996dd9faa1aa", "date": "Fri, 01 Aug 2025 16:03:49 GMT"} })
43712025-08-01T16:03:50.300ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 541.261771ms iteration = 13 status = {}
43722025-08-01T16:03:50.314ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43732025-08-01T16:03:50.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43742025-08-01T16:03:50.316ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 3f21d9d5-3adf-463a-a05d-bc2e2e5d64ca, rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(4c7da70d-ede0-4107-abc5-5650a053be38) } rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
43752025-08-01T16:03:50.316ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43762025-08-01T16:03:50.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43772025-08-01T16:03:50.333ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
43782025-08-01T16:03:50.333ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 4c7da70d-ede0-4107-abc5-5650a053be38
43792025-08-01T16:03:50.333ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
43802025-08-01T16:03:50.333ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
43812025-08-01T16:03:50.333ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43822025-08-01T16:03:50.333ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43832025-08-01T16:03:50.333ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43842025-08-01T16:03:50.333ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
43852025-08-01T16:03:50.334ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43862025-08-01T16:03:50.334ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
43872025-08-01T16:03:50.334ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
43882025-08-01T16:03:50.334ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43892025-08-01T16:03:50.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43902025-08-01T16:03:50.336ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
43912025-08-01T16:03:50.336ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
43922025-08-01T16:03:50.440ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0813076a-7db1-4b1c-a800-d2e02c5e817b", "date": "Fri, 01 Aug 2025 16:03:50 GMT"} })
43932025-08-01T16:03:50.440ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch = Switch0
43942025-08-01T16:03:50.440ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
43952025-08-01T16:03:50.441ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "23a2b3c0-220e-4659-a2eb-0a38be9f7aa7", "content-length": "682", "date": "Fri, 01 Aug 2025 16:03:50 GMT"} })
43962025-08-01T16:03:50.441ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43972025-08-01T16:03:50.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43982025-08-01T16:03:50.445ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43992025-08-01T16:03:50.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44002025-08-01T16:03:50.449ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44012025-08-01T16:03:50.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44022025-08-01T16:03:50.451ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44032025-08-01T16:03:50.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44042025-08-01T16:03:50.458ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 699.576932ms iteration = 13 status = {}
44052025-08-01T16:03:50.579ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 2
44062025-08-01T16:03:50.579ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221
44072025-08-01T16:03:50.608ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
44082025-08-01T16:03:50.609ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:50746
44092025-08-01T16:03:50.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:50746 req_id = 5191ebea-815f-4055-8bf2-82151bda6538 roles = RoleSet { roles: {} } uri = /metrics/producers
44102025-08-01T16:03:50.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:50746 req_id = 5191ebea-815f-4055-8bf2-82151bda6538 resource = Database result = Ok(()) uri = /metrics/producers
44112025-08-01T16:03:50.650ZINFOnexus: assigned collector to new producer collector_id = 7bf2727d-8ae8-417c-81cf-59aa0ad1690b file = nexus/src/app/oximeter.rs:76 producer_id = 7248190d-c184-423c-8431-31fe40a79e2e
44122025-08-01T16:03:50.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 41279 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:50746 req_id = 5191ebea-815f-4055-8bf2-82151bda6538 response_code = 201 uri = /metrics/producers
44132025-08-01T16:03:50.650ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "5191ebea-815f-4055-8bf2-82151bda6538", "content-length": "41", "date": "Fri, 01 Aug 2025 16:03:50 GMT"} })
44142025-08-01T16:03:50.652ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
44152025-08-01T16:03:51.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3935ce2b-10bb-4238-851a-25d71c9a6f0c roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44162025-08-01T16:03:51.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3935ce2b-10bb-4238-851a-25d71c9a6f0c resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44172025-08-01T16:03:51.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2585 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3935ce2b-10bb-4238-851a-25d71c9a6f0c response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44182025-08-01T16:03:52.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c772163e-0249-4500-955e-c4915d08a634 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44192025-08-01T16:03:52.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c772163e-0249-4500-955e-c4915d08a634 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44202025-08-01T16:03:52.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2196 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c772163e-0249-4500-955e-c4915d08a634 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44212025-08-01T16:03:53.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 17c0517b-00fb-4231-bdcc-016b34389daa roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44222025-08-01T16:03:53.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 17c0517b-00fb-4231-bdcc-016b34389daa resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44232025-08-01T16:03:53.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1712 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 17c0517b-00fb-4231-bdcc-016b34389daa response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44242025-08-01T16:03:54.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 25887178-3972-47aa-b77d-031eddd4643e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44252025-08-01T16:03:54.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 25887178-3972-47aa-b77d-031eddd4643e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44262025-08-01T16:03:54.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2936 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 25887178-3972-47aa-b77d-031eddd4643e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44272025-08-01T16:03:54.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 74 reason = Timeout
44282025-08-01T16:03:54.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
44292025-08-01T16:03:54.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
44302025-08-01T16:03:54.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44312025-08-01T16:03:54.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
44322025-08-01T16:03:54.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
44332025-08-01T16:03:54.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
44342025-08-01T16:03:54.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
44352025-08-01T16:03:54.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.762585ms iteration = 74 status = {"chicken_switches_updated":false}
44362025-08-01T16:03:55.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bab03fd6-b580-4987-998e-0af6562d045e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44372025-08-01T16:03:55.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bab03fd6-b580-4987-998e-0af6562d045e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44382025-08-01T16:03:55.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2368 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bab03fd6-b580-4987-998e-0af6562d045e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44392025-08-01T16:03:56.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4e368ca9-ec5e-4917-ba15-9f54b38f35f3 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44402025-08-01T16:03:56.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4e368ca9-ec5e-4917-ba15-9f54b38f35f3 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44412025-08-01T16:03:56.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2112 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4e368ca9-ec5e-4917-ba15-9f54b38f35f3 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44422025-08-01T16:03:57.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fe1d92e1-34b8-4e44-98d9-5fde142120db roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44432025-08-01T16:03:57.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fe1d92e1-34b8-4e44-98d9-5fde142120db resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44442025-08-01T16:03:57.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2521 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fe1d92e1-34b8-4e44-98d9-5fde142120db response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44452025-08-01T16:03:58.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 41b59a95-54b2-447d-814e-34f9a8bbf538 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44462025-08-01T16:03:58.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 41b59a95-54b2-447d-814e-34f9a8bbf538 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44472025-08-01T16:03:58.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2606 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 41b59a95-54b2-447d-814e-34f9a8bbf538 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44482025-08-01T16:03:59.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 07ee3ac8-bcc6-4cdd-af5b-dbe1b373cbc0 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44492025-08-01T16:03:59.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 07ee3ac8-bcc6-4cdd-af5b-dbe1b373cbc0 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44502025-08-01T16:03:59.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2217 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 07ee3ac8-bcc6-4cdd-af5b-dbe1b373cbc0 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44512025-08-01T16:03:59.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
44522025-08-01T16:03:59.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 75 reason = Timeout
44532025-08-01T16:03:59.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44542025-08-01T16:03:59.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
44552025-08-01T16:03:59.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
44562025-08-01T16:03:59.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44572025-08-01T16:03:59.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
44582025-08-01T16:03:59.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44592025-08-01T16:03:59.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44602025-08-01T16:03:59.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44612025-08-01T16:03:59.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44622025-08-01T16:03:59.763ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44632025-08-01T16:03:59.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44642025-08-01T16:03:59.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
44652025-08-01T16:03:59.766ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
44662025-08-01T16:03:59.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
44672025-08-01T16:03:59.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44682025-08-01T16:03:59.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44692025-08-01T16:03:59.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44702025-08-01T16:03:59.768ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
44712025-08-01T16:03:59.768ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.537418ms iteration = 75 status = {"chicken_switches_updated":false}
44722025-08-01T16:03:59.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44732025-08-01T16:03:59.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44742025-08-01T16:03:59.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44752025-08-01T16:03:59.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
44762025-08-01T16:03:59.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44772025-08-01T16:03:59.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44782025-08-01T16:03:59.789ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
44792025-08-01T16:03:59.789ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 29.854956ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
44802025-08-01T16:03:59.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 42.692005ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44812025-08-01T16:03:59.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 554 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 71f394b9-0a7a-4437-8fb2-93e32ddc88ba response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
44822025-08-01T16:04:00.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 187df45d-2034-4f65-b111-b60c15d46d85 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44832025-08-01T16:04:00.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 187df45d-2034-4f65-b111-b60c15d46d85 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44842025-08-01T16:04:00.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2360 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 187df45d-2034-4f65-b111-b60c15d46d85 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44852025-08-01T16:04:01.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bf5b6bb0-7e69-4ff7-96c9-52f3604a6bf1 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44862025-08-01T16:04:01.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bf5b6bb0-7e69-4ff7-96c9-52f3604a6bf1 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44872025-08-01T16:04:01.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2408 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bf5b6bb0-7e69-4ff7-96c9-52f3604a6bf1 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44882025-08-01T16:04:02.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9f56d151-60cd-431e-b4ec-6b934c126a4b roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44892025-08-01T16:04:02.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9f56d151-60cd-431e-b4ec-6b934c126a4b resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44902025-08-01T16:04:02.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2336 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9f56d151-60cd-431e-b4ec-6b934c126a4b response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44912025-08-01T16:04:03.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2923797f-2f28-4fed-ae56-a1a2766fcbe8 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44922025-08-01T16:04:03.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2923797f-2f28-4fed-ae56-a1a2766fcbe8 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44932025-08-01T16:04:03.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1820 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2923797f-2f28-4fed-ae56-a1a2766fcbe8 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44942025-08-01T16:04:04.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1f3b5b95-fe18-463c-96f3-bda2f703ff16 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44952025-08-01T16:04:04.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1f3b5b95-fe18-463c-96f3-bda2f703ff16 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44962025-08-01T16:04:04.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2255 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1f3b5b95-fe18-463c-96f3-bda2f703ff16 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
44972025-08-01T16:04:04.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 76 reason = Timeout
44982025-08-01T16:04:04.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
44992025-08-01T16:04:04.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
45002025-08-01T16:04:04.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45012025-08-01T16:04:04.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
45022025-08-01T16:04:04.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
45032025-08-01T16:04:04.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
45042025-08-01T16:04:04.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
45052025-08-01T16:04:04.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.026273ms iteration = 76 status = {"chicken_switches_updated":false}
45062025-08-01T16:04:05.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 483938d7-ca07-4f83-af42-3797c9839285 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45072025-08-01T16:04:05.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 483938d7-ca07-4f83-af42-3797c9839285 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45082025-08-01T16:04:05.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2158 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 483938d7-ca07-4f83-af42-3797c9839285 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45092025-08-01T16:04:06.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d6a9c800-c2e4-443f-9f45-4b712c06426e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45102025-08-01T16:04:06.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d6a9c800-c2e4-443f-9f45-4b712c06426e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45112025-08-01T16:04:06.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1947 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d6a9c800-c2e4-443f-9f45-4b712c06426e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45122025-08-01T16:04:07.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 62163966-f8ba-4b33-9209-66bf45a1f0fa roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45132025-08-01T16:04:07.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 62163966-f8ba-4b33-9209-66bf45a1f0fa resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45142025-08-01T16:04:07.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2198 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 62163966-f8ba-4b33-9209-66bf45a1f0fa response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45152025-08-01T16:04:08.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c62f2d23-2265-4c83-9e1a-c08d2ba804a8 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45162025-08-01T16:04:08.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c62f2d23-2265-4c83-9e1a-c08d2ba804a8 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45172025-08-01T16:04:08.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2056 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c62f2d23-2265-4c83-9e1a-c08d2ba804a8 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45182025-08-01T16:04:09.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 51c15a18-37b3-44be-a175-73c23979c38c roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45192025-08-01T16:04:09.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 51c15a18-37b3-44be-a175-73c23979c38c resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45202025-08-01T16:04:09.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2400 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 51c15a18-37b3-44be-a175-73c23979c38c response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45212025-08-01T16:04:09.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
45222025-08-01T16:04:09.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45232025-08-01T16:04:09.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 77 reason = Timeout
45242025-08-01T16:04:09.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
45252025-08-01T16:04:09.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45262025-08-01T16:04:09.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
45272025-08-01T16:04:09.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45282025-08-01T16:04:09.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
45292025-08-01T16:04:09.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45302025-08-01T16:04:09.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45312025-08-01T16:04:09.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45322025-08-01T16:04:09.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45332025-08-01T16:04:09.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45342025-08-01T16:04:09.765ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 6.139026ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45352025-08-01T16:04:09.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
45362025-08-01T16:04:09.767ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
45372025-08-01T16:04:09.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
45382025-08-01T16:04:09.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45392025-08-01T16:04:09.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45402025-08-01T16:04:09.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45412025-08-01T16:04:09.769ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
45422025-08-01T16:04:09.769ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 10.317593ms iteration = 77 status = {"chicken_switches_updated":false}
45432025-08-01T16:04:09.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45442025-08-01T16:04:09.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45452025-08-01T16:04:09.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45462025-08-01T16:04:09.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
45472025-08-01T16:04:09.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45482025-08-01T16:04:09.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45492025-08-01T16:04:09.788ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
45502025-08-01T16:04:09.788ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.901327ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
45512025-08-01T16:04:09.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 636 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = c19794d9-cabf-4e23-84c0-3c6c14e8e8a0 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
45522025-08-01T16:04:10.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d05eb855-1b30-4d06-8f7f-549dccc97f1c roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45532025-08-01T16:04:10.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d05eb855-1b30-4d06-8f7f-549dccc97f1c resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45542025-08-01T16:04:10.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2197 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d05eb855-1b30-4d06-8f7f-549dccc97f1c response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45552025-08-01T16:04:11.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5b54975b-1959-490a-837a-da1f0219a536 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45562025-08-01T16:04:11.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5b54975b-1959-490a-837a-da1f0219a536 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45572025-08-01T16:04:11.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2135 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5b54975b-1959-490a-837a-da1f0219a536 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45582025-08-01T16:04:12.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1d5f939b-1d8e-4f57-ab6b-f5c235c87bb3 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45592025-08-01T16:04:12.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1d5f939b-1d8e-4f57-ab6b-f5c235c87bb3 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45602025-08-01T16:04:12.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2353 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1d5f939b-1d8e-4f57-ab6b-f5c235c87bb3 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45612025-08-01T16:04:13.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fa86f544-71c3-438f-8e55-3a3298de54cf roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45622025-08-01T16:04:13.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fa86f544-71c3-438f-8e55-3a3298de54cf resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45632025-08-01T16:04:13.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1768 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fa86f544-71c3-438f-8e55-3a3298de54cf response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45642025-08-01T16:04:14.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5aa117c6-b3ff-460b-9191-f754da112d19 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45652025-08-01T16:04:14.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5aa117c6-b3ff-460b-9191-f754da112d19 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45662025-08-01T16:04:14.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2783 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5aa117c6-b3ff-460b-9191-f754da112d19 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45672025-08-01T16:04:14.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 78 reason = Timeout
45682025-08-01T16:04:14.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
45692025-08-01T16:04:14.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
45702025-08-01T16:04:14.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45712025-08-01T16:04:14.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
45722025-08-01T16:04:14.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
45732025-08-01T16:04:14.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
45742025-08-01T16:04:14.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
45752025-08-01T16:04:14.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.779106ms iteration = 78 status = {"chicken_switches_updated":false}
45762025-08-01T16:04:15.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f8ac7410-fb01-433c-9828-12cc3ecf576c roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45772025-08-01T16:04:15.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f8ac7410-fb01-433c-9828-12cc3ecf576c resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45782025-08-01T16:04:15.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2437 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f8ac7410-fb01-433c-9828-12cc3ecf576c response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45792025-08-01T16:04:16.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 14c3d5e8-def1-4360-ba9e-e56fa3fbe5bd roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45802025-08-01T16:04:16.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 14c3d5e8-def1-4360-ba9e-e56fa3fbe5bd resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45812025-08-01T16:04:16.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1864 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 14c3d5e8-def1-4360-ba9e-e56fa3fbe5bd response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45822025-08-01T16:04:17.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2b6509bc-4fe7-4eba-ae4b-7213ef51876f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45832025-08-01T16:04:17.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2b6509bc-4fe7-4eba-ae4b-7213ef51876f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45842025-08-01T16:04:17.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2241 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2b6509bc-4fe7-4eba-ae4b-7213ef51876f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45852025-08-01T16:04:18.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5eb8ecce-0544-4487-9dbb-6c385488beb0 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45862025-08-01T16:04:18.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5eb8ecce-0544-4487-9dbb-6c385488beb0 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45872025-08-01T16:04:18.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2494 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5eb8ecce-0544-4487-9dbb-6c385488beb0 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
45882025-08-01T16:04:19.687ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
45892025-08-01T16:04:19.687ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
45902025-08-01T16:04:19.687ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
45912025-08-01T16:04:19.687ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45922025-08-01T16:04:19.688ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
45932025-08-01T16:04:19.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
45942025-08-01T16:04:19.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45952025-08-01T16:04:19.690ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43955, tv_nsec: 706576012 } })
45962025-08-01T16:04:19.690ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
45972025-08-01T16:04:19.691ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43955, tv_nsec: 707154220 } })
45982025-08-01T16:04:19.691ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
45992025-08-01T16:04:19.691ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.802105ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
46002025-08-01T16:04:19.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c5d856fa-7ae6-4597-939e-ec8c0c7bb01d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
46012025-08-01T16:04:19.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c5d856fa-7ae6-4597-939e-ec8c0c7bb01d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
46022025-08-01T16:04:19.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1937 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c5d856fa-7ae6-4597-939e-ec8c0c7bb01d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
46032025-08-01T16:04:19.752ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
46042025-08-01T16:04:19.752ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46052025-08-01T16:04:19.753ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce0208b1-99d4-42cf-afc7-7f1e05f9a9da", "content-length": "26", "date": "Fri, 01 Aug 2025 16:04:19 GMT"} })
46062025-08-01T16:04:19.753ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46072025-08-01T16:04:19.753ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
46082025-08-01T16:04:19.753ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46092025-08-01T16:04:19.753ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "854061fd-0769-40fd-9047-849dbc3d5d63", "content-length": "26", "date": "Fri, 01 Aug 2025 16:04:19 GMT"} })
46102025-08-01T16:04:19.753ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46112025-08-01T16:04:19.754ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46122025-08-01T16:04:19.755ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46132025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 14 reason = Timeout
46142025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
46152025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
46162025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 15.811\u{b5}s iteration = 14 status = {"disabled":true,"errors":[],"sps":[]}
46172025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46182025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
46192025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
46202025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46212025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 14 reason = Timeout
46222025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46232025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
46242025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
46252025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
46262025-08-01T16:04:19.759ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
46272025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46282025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
46292025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46302025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 79 reason = Timeout
46312025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46322025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
46332025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
46342025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
46352025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
46362025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
46372025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 14 reason = Timeout
46382025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
46392025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
46402025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46412025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
46422025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
46432025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46442025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46452025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
46462025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46472025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
46482025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46492025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
46502025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46512025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
46522025-08-01T16:04:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46532025-08-01T16:04:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46542025-08-01T16:04:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46552025-08-01T16:04:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
46562025-08-01T16:04:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
46572025-08-01T16:04:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46582025-08-01T16:04:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
46592025-08-01T16:04:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46602025-08-01T16:04:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46612025-08-01T16:04:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46622025-08-01T16:04:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46632025-08-01T16:04:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46642025-08-01T16:04:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46652025-08-01T16:04:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
46662025-08-01T16:04:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46672025-08-01T16:04:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46682025-08-01T16:04:19.761ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46692025-08-01T16:04:19.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46702025-08-01T16:04:19.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46712025-08-01T16:04:19.762ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46722025-08-01T16:04:19.762ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
46732025-08-01T16:04:19.762ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46742025-08-01T16:04:19.762ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46752025-08-01T16:04:19.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46762025-08-01T16:04:19.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46772025-08-01T16:04:19.763ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46782025-08-01T16:04:19.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
46792025-08-01T16:04:19.763ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
46802025-08-01T16:04:19.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
46812025-08-01T16:04:19.765ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46822025-08-01T16:04:19.765ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46832025-08-01T16:04:19.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
46842025-08-01T16:04:19.766ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46852025-08-01T16:04:19.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46862025-08-01T16:04:19.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46872025-08-01T16:04:19.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46882025-08-01T16:04:19.767ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46892025-08-01T16:04:19.767ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 7.712443ms iteration = 14 status = {"errors":[],"requests_created_ok":[]}
46902025-08-01T16:04:19.767ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46912025-08-01T16:04:19.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46922025-08-01T16:04:19.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
46932025-08-01T16:04:19.767ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
46942025-08-01T16:04:19.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46952025-08-01T16:04:19.767ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46962025-08-01T16:04:19.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
46972025-08-01T16:04:19.769ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46982025-08-01T16:04:19.769ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46992025-08-01T16:04:19.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47002025-08-01T16:04:19.770ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 10.88548ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47012025-08-01T16:04:19.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
47022025-08-01T16:04:19.771ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47032025-08-01T16:04:19.771ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47042025-08-01T16:04:19.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47052025-08-01T16:04:19.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47062025-08-01T16:04:19.771ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43955, tv_nsec: 787424854 } })
47072025-08-01T16:04:19.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47082025-08-01T16:04:19.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47092025-08-01T16:04:19.771ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
47102025-08-01T16:04:19.771ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 12.069556ms iteration = 79 status = {"chicken_switches_updated":false}
47112025-08-01T16:04:19.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47122025-08-01T16:04:19.771ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
47132025-08-01T16:04:19.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
47142025-08-01T16:04:19.771ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47152025-08-01T16:04:19.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47162025-08-01T16:04:19.773ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47172025-08-01T16:04:19.773ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47182025-08-01T16:04:19.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47192025-08-01T16:04:19.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47202025-08-01T16:04:19.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47212025-08-01T16:04:19.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47222025-08-01T16:04:19.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47232025-08-01T16:04:19.775ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47242025-08-01T16:04:19.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47252025-08-01T16:04:19.777ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47262025-08-01T16:04:19.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47272025-08-01T16:04:19.779ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
47282025-08-01T16:04:19.779ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47292025-08-01T16:04:19.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47302025-08-01T16:04:19.786ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47312025-08-01T16:04:19.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47322025-08-01T16:04:19.787ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47332025-08-01T16:04:19.789ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47342025-08-01T16:04:19.789ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47352025-08-01T16:04:19.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47362025-08-01T16:04:19.791ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47372025-08-01T16:04:19.794ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47382025-08-01T16:04:19.794ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47392025-08-01T16:04:19.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47402025-08-01T16:04:19.808ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
47412025-08-01T16:04:19.808ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.750168ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
47422025-08-01T16:04:19.814ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47432025-08-01T16:04:19.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47442025-08-01T16:04:19.817ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 57.37839ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
47452025-08-01T16:04:19.821ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.265088ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47462025-08-01T16:04:19.824ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 64.698741ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
47472025-08-01T16:04:19.825ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
47482025-08-01T16:04:19.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
47492025-08-01T16:04:19.825ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 137.752717ms iteration = 14 status = {}
47502025-08-01T16:04:19.826ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
47512025-08-01T16:04:19.827ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47522025-08-01T16:04:19.827ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47532025-08-01T16:04:19.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
47542025-08-01T16:04:19.828ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47552025-08-01T16:04:19.828ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47562025-08-01T16:04:19.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47572025-08-01T16:04:19.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47582025-08-01T16:04:19.830ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47592025-08-01T16:04:19.831ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47602025-08-01T16:04:19.831ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
47612025-08-01T16:04:19.831ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47622025-08-01T16:04:19.831ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 143.285635ms iteration = 14 status = null
47632025-08-01T16:04:19.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47642025-08-01T16:04:19.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47652025-08-01T16:04:19.831ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47662025-08-01T16:04:19.831ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47672025-08-01T16:04:19.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47682025-08-01T16:04:19.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
47692025-08-01T16:04:19.832ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
47702025-08-01T16:04:19.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
47712025-08-01T16:04:19.834ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47722025-08-01T16:04:19.834ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
47732025-08-01T16:04:19.834ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 74.655834ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
47742025-08-01T16:04:19.835ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
47752025-08-01T16:04:19.835ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 75.335424ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
47762025-08-01T16:04:19.840ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47772025-08-01T16:04:19.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
47782025-08-01T16:04:19.845ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47792025-08-01T16:04:19.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47802025-08-01T16:04:19.847ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 88.221165ms iteration = 14 status = 0
47812025-08-01T16:04:19.860ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 zone_address = fd00:1122:3344:101::2
47822025-08-01T16:04:19.860ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47832025-08-01T16:04:19.860ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "50b0d6bb-21bf-4ef7-a966-571d93bed974", "content-length": "26", "date": "Fri, 01 Aug 2025 16:04:19 GMT"} })
47842025-08-01T16:04:19.860ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47852025-08-01T16:04:19.863ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
47862025-08-01T16:04:19.876ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47872025-08-01T16:04:19.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47882025-08-01T16:04:19.879ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 119.306068ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
47892025-08-01T16:04:19.888ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
47902025-08-01T16:04:19.889ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a0ab5c8-bd62-4d91-9549-816c345d36b7", "content-length": "691", "date": "Fri, 01 Aug 2025 16:04:19 GMT"} })
47912025-08-01T16:04:19.889ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
47922025-08-01T16:04:19.889ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
47932025-08-01T16:04:19.889ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
47942025-08-01T16:04:19.891ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 132.410225ms iteration = 14 status = {}
47952025-08-01T16:04:19.893ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:391
47962025-08-01T16:04:19.893ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 134.191049ms iteration = 14 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
47972025-08-01T16:04:19.898ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 138.344374ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47982025-08-01T16:04:19.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 888 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 2d6ce6fe-f2ab-4d28-a5a6-2b332fd57d57 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
47992025-08-01T16:04:19.952ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 193.137616ms iteration = 16 status = {"physical_disks_added":0}
48002025-08-01T16:04:20.003ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
48012025-08-01T16:04:20.003ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48022025-08-01T16:04:20.004ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "65a537fe-62c7-46b4-b187-a4c6fad6b738", "content-length": "372", "date": "Fri, 01 Aug 2025 16:04:19 GMT"} })
48032025-08-01T16:04:20.004ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48042025-08-01T16:04:20.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48052025-08-01T16:04:20.007ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48062025-08-01T16:04:20.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48072025-08-01T16:04:20.009ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 3f21d9d5-3adf-463a-a05d-bc2e2e5d64ca, rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(4c7da70d-ede0-4107-abc5-5650a053be38) } rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
48082025-08-01T16:04:20.009ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48092025-08-01T16:04:20.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48102025-08-01T16:04:20.021ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
48112025-08-01T16:04:20.021ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 4c7da70d-ede0-4107-abc5-5650a053be38
48122025-08-01T16:04:20.021ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
48132025-08-01T16:04:20.021ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
48142025-08-01T16:04:20.021ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48152025-08-01T16:04:20.021ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48162025-08-01T16:04:20.021ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48172025-08-01T16:04:20.021ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48182025-08-01T16:04:20.021ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48192025-08-01T16:04:20.021ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48202025-08-01T16:04:20.021ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
48212025-08-01T16:04:20.021ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48222025-08-01T16:04:20.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48232025-08-01T16:04:20.023ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
48242025-08-01T16:04:20.023ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
48252025-08-01T16:04:20.058ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
48262025-08-01T16:04:20.058ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
48272025-08-01T16:04:20.060ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "50a4ae13-3f14-49dd-b9d1-90225901c1f1", "date": "Fri, 01 Aug 2025 16:04:20 GMT"} })
48282025-08-01T16:04:20.060ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48292025-08-01T16:04:20.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48302025-08-01T16:04:20.063ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48312025-08-01T16:04:20.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48322025-08-01T16:04:20.066ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48332025-08-01T16:04:20.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48342025-08-01T16:04:20.070ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
48352025-08-01T16:04:20.070ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48362025-08-01T16:04:20.077ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "47b6eab3-c0f0-412e-9e0e-bd239c9c59b2", "date": "Fri, 01 Aug 2025 16:04:19 GMT"} })
48372025-08-01T16:04:20.078ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 319.007493ms iteration = 14 status = {}
48382025-08-01T16:04:20.248ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6a82343f-319a-4f3d-ad5f-8d162b05de83", "date": "Fri, 01 Aug 2025 16:04:19 GMT"} })
48392025-08-01T16:04:20.248ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch = Switch0
48402025-08-01T16:04:20.248ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
48412025-08-01T16:04:20.248ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "900e4289-53f6-474f-b62e-91cd45606b4c", "content-length": "682", "date": "Fri, 01 Aug 2025 16:04:20 GMT"} })
48422025-08-01T16:04:20.248ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48432025-08-01T16:04:20.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48442025-08-01T16:04:20.252ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48452025-08-01T16:04:20.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48462025-08-01T16:04:20.256ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48472025-08-01T16:04:20.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48482025-08-01T16:04:20.257ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48492025-08-01T16:04:20.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48502025-08-01T16:04:20.265ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 506.006822ms iteration = 14 status = {}
48512025-08-01T16:04:20.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4068b993-21bf-4914-8724-b14072fae6f7 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
48522025-08-01T16:04:20.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4068b993-21bf-4914-8724-b14072fae6f7 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
48532025-08-01T16:04:20.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2586 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4068b993-21bf-4914-8724-b14072fae6f7 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
48542025-08-01T16:04:21.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 64590094-3488-4fcd-a8ad-e05485f6e8f0 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
48552025-08-01T16:04:21.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 64590094-3488-4fcd-a8ad-e05485f6e8f0 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
48562025-08-01T16:04:21.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2437 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 64590094-3488-4fcd-a8ad-e05485f6e8f0 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
48572025-08-01T16:04:22.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 869bc2fc-2358-4919-93b0-32a358e71320 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
48582025-08-01T16:04:22.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 869bc2fc-2358-4919-93b0-32a358e71320 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
48592025-08-01T16:04:22.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3104 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 869bc2fc-2358-4919-93b0-32a358e71320 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
48602025-08-01T16:04:23.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b84e6adc-2455-44ab-84a0-779fe0c6b6b0 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
48612025-08-01T16:04:23.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b84e6adc-2455-44ab-84a0-779fe0c6b6b0 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
48622025-08-01T16:04:23.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1951 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b84e6adc-2455-44ab-84a0-779fe0c6b6b0 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
48632025-08-01T16:04:24.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 80 reason = Timeout
48642025-08-01T16:04:24.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
48652025-08-01T16:04:24.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
48662025-08-01T16:04:24.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48672025-08-01T16:04:24.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
48682025-08-01T16:04:24.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
48692025-08-01T16:04:24.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
48702025-08-01T16:04:24.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
48712025-08-01T16:04:24.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.146967ms iteration = 80 status = {"chicken_switches_updated":false}
48722025-08-01T16:04:24.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b539d04f-0904-46fd-a155-699f2ab9c7f3 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
48732025-08-01T16:04:24.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b539d04f-0904-46fd-a155-699f2ab9c7f3 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
48742025-08-01T16:04:24.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1524 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b539d04f-0904-46fd-a155-699f2ab9c7f3 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
48752025-08-01T16:04:25.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 81059f12-f1d5-467c-bdf5-63d212acbdb9 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
48762025-08-01T16:04:25.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 81059f12-f1d5-467c-bdf5-63d212acbdb9 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
48772025-08-01T16:04:25.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2108 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 81059f12-f1d5-467c-bdf5-63d212acbdb9 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
48782025-08-01T16:04:26.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b005b933-e3a6-42fd-b09c-13ffb5bb045d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
48792025-08-01T16:04:26.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b005b933-e3a6-42fd-b09c-13ffb5bb045d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
48802025-08-01T16:04:26.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1941 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b005b933-e3a6-42fd-b09c-13ffb5bb045d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
48812025-08-01T16:04:27.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0e49833b-45bb-431c-904a-bbb10152ad6d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
48822025-08-01T16:04:27.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0e49833b-45bb-431c-904a-bbb10152ad6d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
48832025-08-01T16:04:27.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2563 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0e49833b-45bb-431c-904a-bbb10152ad6d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
48842025-08-01T16:04:28.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ce64aabd-3102-4c92-a912-0eb9c60a43d9 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
48852025-08-01T16:04:28.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ce64aabd-3102-4c92-a912-0eb9c60a43d9 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
48862025-08-01T16:04:28.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2465 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ce64aabd-3102-4c92-a912-0eb9c60a43d9 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
48872025-08-01T16:04:29.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
48882025-08-01T16:04:29.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48892025-08-01T16:04:29.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 81 reason = Timeout
48902025-08-01T16:04:29.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
48912025-08-01T16:04:29.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
48922025-08-01T16:04:29.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48932025-08-01T16:04:29.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
48942025-08-01T16:04:29.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48952025-08-01T16:04:29.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48962025-08-01T16:04:29.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48972025-08-01T16:04:29.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48982025-08-01T16:04:29.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
48992025-08-01T16:04:29.767ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
49002025-08-01T16:04:29.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
49012025-08-01T16:04:29.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49022025-08-01T16:04:29.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49032025-08-01T16:04:29.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49042025-08-01T16:04:29.769ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
49052025-08-01T16:04:29.769ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 11.049125ms iteration = 81 status = {"chicken_switches_updated":false}
49062025-08-01T16:04:29.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49072025-08-01T16:04:29.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49082025-08-01T16:04:29.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49092025-08-01T16:04:29.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
49102025-08-01T16:04:29.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49112025-08-01T16:04:29.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49122025-08-01T16:04:29.793ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
49132025-08-01T16:04:29.793ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 33.537027ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
49142025-08-01T16:04:29.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49152025-08-01T16:04:29.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49162025-08-01T16:04:29.798ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.353794ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49172025-08-01T16:04:29.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ce4ee60e-7666-41a3-91f5-222ed1725ef0 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49182025-08-01T16:04:29.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ce4ee60e-7666-41a3-91f5-222ed1725ef0 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49192025-08-01T16:04:29.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2139 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ce4ee60e-7666-41a3-91f5-222ed1725ef0 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49202025-08-01T16:04:29.913ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::d]:50110
49212025-08-01T16:04:29.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50110 req_id = 29fd5007-6ca2-4c7d-8e07-92f806ea1c89 roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
49222025-08-01T16:04:29.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50110 req_id = 29fd5007-6ca2-4c7d-8e07-92f806ea1c89 resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
49232025-08-01T16:04:29.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2943 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50110 req_id = 29fd5007-6ca2-4c7d-8e07-92f806ea1c89 response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
49242025-08-01T16:04:29.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50110 req_id = eac93bd5-1208-4cb5-bf7f-7aee1bdf86c0 roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
49252025-08-01T16:04:29.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50110 req_id = eac93bd5-1208-4cb5-bf7f-7aee1bdf86c0 resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
49262025-08-01T16:04:29.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1984 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50110 req_id = eac93bd5-1208-4cb5-bf7f-7aee1bdf86c0 response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
49272025-08-01T16:04:29.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 503 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 39ae1ae3-3370-455b-81ff-c3088052ddcd response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
49282025-08-01T16:04:30.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4d79ef40-fa89-430c-acd6-6c67267bd8ce roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49292025-08-01T16:04:30.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4d79ef40-fa89-430c-acd6-6c67267bd8ce resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49302025-08-01T16:04:30.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1831 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4d79ef40-fa89-430c-acd6-6c67267bd8ce response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49312025-08-01T16:04:31.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bac18e60-9bd2-485a-92e7-1144fd5dde5e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49322025-08-01T16:04:31.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bac18e60-9bd2-485a-92e7-1144fd5dde5e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49332025-08-01T16:04:31.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2688 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bac18e60-9bd2-485a-92e7-1144fd5dde5e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49342025-08-01T16:04:32.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 209567e5-08bf-4d9c-8d09-396c8b1a265e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49352025-08-01T16:04:32.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 209567e5-08bf-4d9c-8d09-396c8b1a265e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49362025-08-01T16:04:32.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2129 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 209567e5-08bf-4d9c-8d09-396c8b1a265e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49372025-08-01T16:04:33.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f3e5bf0d-19cc-4611-959c-613a1216eed0 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49382025-08-01T16:04:33.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f3e5bf0d-19cc-4611-959c-613a1216eed0 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49392025-08-01T16:04:33.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2013 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f3e5bf0d-19cc-4611-959c-613a1216eed0 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49402025-08-01T16:04:34.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 82 reason = Timeout
49412025-08-01T16:04:34.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
49422025-08-01T16:04:34.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
49432025-08-01T16:04:34.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49442025-08-01T16:04:34.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
49452025-08-01T16:04:34.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
49462025-08-01T16:04:34.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
49472025-08-01T16:04:34.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
49482025-08-01T16:04:34.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.196208ms iteration = 82 status = {"chicken_switches_updated":false}
49492025-08-01T16:04:34.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7622004d-74d4-499f-a45c-9f1ef4d4ba18 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49502025-08-01T16:04:34.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7622004d-74d4-499f-a45c-9f1ef4d4ba18 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49512025-08-01T16:04:34.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2195 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7622004d-74d4-499f-a45c-9f1ef4d4ba18 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49522025-08-01T16:04:36.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e2660e03-850a-4ace-a7cc-2970f3923dd1 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49532025-08-01T16:04:36.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e2660e03-850a-4ace-a7cc-2970f3923dd1 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49542025-08-01T16:04:36.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2142 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e2660e03-850a-4ace-a7cc-2970f3923dd1 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49552025-08-01T16:04:37.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 571e2f4d-af86-4ebb-ad62-56602cf78c0b roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49562025-08-01T16:04:37.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 571e2f4d-af86-4ebb-ad62-56602cf78c0b resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49572025-08-01T16:04:37.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2610 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 571e2f4d-af86-4ebb-ad62-56602cf78c0b response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49582025-08-01T16:04:38.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 357f6758-b430-458d-87f6-bea18eb7f10b roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49592025-08-01T16:04:38.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 357f6758-b430-458d-87f6-bea18eb7f10b resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49602025-08-01T16:04:38.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1984 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 357f6758-b430-458d-87f6-bea18eb7f10b response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49612025-08-01T16:04:39.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b27dd090-a4d4-4b5a-bbaf-0c129914c66f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49622025-08-01T16:04:39.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b27dd090-a4d4-4b5a-bbaf-0c129914c66f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49632025-08-01T16:04:39.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2264 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b27dd090-a4d4-4b5a-bbaf-0c129914c66f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49642025-08-01T16:04:39.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
49652025-08-01T16:04:39.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 83 reason = Timeout
49662025-08-01T16:04:39.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49672025-08-01T16:04:39.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
49682025-08-01T16:04:39.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
49692025-08-01T16:04:39.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49702025-08-01T16:04:39.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
49712025-08-01T16:04:39.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49722025-08-01T16:04:39.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49732025-08-01T16:04:39.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49742025-08-01T16:04:39.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49752025-08-01T16:04:39.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
49762025-08-01T16:04:39.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
49772025-08-01T16:04:39.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
49782025-08-01T16:04:39.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49792025-08-01T16:04:39.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49802025-08-01T16:04:39.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49812025-08-01T16:04:39.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
49822025-08-01T16:04:39.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.57508ms iteration = 83 status = {"chicken_switches_updated":false}
49832025-08-01T16:04:39.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49842025-08-01T16:04:39.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49852025-08-01T16:04:39.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49862025-08-01T16:04:39.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
49872025-08-01T16:04:39.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49882025-08-01T16:04:39.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49892025-08-01T16:04:39.790ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
49902025-08-01T16:04:39.790ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.66537ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
49912025-08-01T16:04:39.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49922025-08-01T16:04:39.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49932025-08-01T16:04:39.798ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.355363ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49942025-08-01T16:04:39.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 625 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = ed894bf3-f95b-4c0d-bc63-133215f8b524 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
49952025-08-01T16:04:40.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dc7790de-69bf-41d7-bdb9-f44b29dacf40 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49962025-08-01T16:04:40.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dc7790de-69bf-41d7-bdb9-f44b29dacf40 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49972025-08-01T16:04:40.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1955 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dc7790de-69bf-41d7-bdb9-f44b29dacf40 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49982025-08-01T16:04:41.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 962853d9-682a-4ada-8866-d35f9e4c29a7 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
49992025-08-01T16:04:41.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 962853d9-682a-4ada-8866-d35f9e4c29a7 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
50002025-08-01T16:04:41.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2211 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 962853d9-682a-4ada-8866-d35f9e4c29a7 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
50012025-08-01T16:04:42.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 089c4a48-a644-436e-8b21-c4ef45fa04bb roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
50022025-08-01T16:04:42.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 089c4a48-a644-436e-8b21-c4ef45fa04bb resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
50032025-08-01T16:04:42.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2857 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 089c4a48-a644-436e-8b21-c4ef45fa04bb response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
50042025-08-01T16:04:43.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e3b3e931-9efb-4790-b512-98a40be577b3 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
50052025-08-01T16:04:43.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e3b3e931-9efb-4790-b512-98a40be577b3 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
50062025-08-01T16:04:43.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2629 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e3b3e931-9efb-4790-b512-98a40be577b3 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
50072025-08-01T16:04:44.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 04d74c41-57b7-404a-b565-4062fd891de2 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
50082025-08-01T16:04:44.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 04d74c41-57b7-404a-b565-4062fd891de2 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
50092025-08-01T16:04:44.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2138 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 04d74c41-57b7-404a-b565-4062fd891de2 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
50102025-08-01T16:04:44.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 84 reason = Timeout
50112025-08-01T16:04:44.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
50122025-08-01T16:04:44.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
50132025-08-01T16:04:44.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50142025-08-01T16:04:44.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
50152025-08-01T16:04:44.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
50162025-08-01T16:04:44.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
50172025-08-01T16:04:44.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
50182025-08-01T16:04:44.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.230079ms iteration = 84 status = {"chicken_switches_updated":false}
50192025-08-01T16:04:45.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4473cec6-f62e-432a-b72b-edc44934876f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
50202025-08-01T16:04:45.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4473cec6-f62e-432a-b72b-edc44934876f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
50212025-08-01T16:04:45.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2282 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4473cec6-f62e-432a-b72b-edc44934876f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
50222025-08-01T16:04:46.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 768716a7-85d9-4cee-8f78-9482718f3ab4 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
50232025-08-01T16:04:46.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 768716a7-85d9-4cee-8f78-9482718f3ab4 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
50242025-08-01T16:04:46.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2719 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 768716a7-85d9-4cee-8f78-9482718f3ab4 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
50252025-08-01T16:04:47.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = aff6c664-f0c6-4e7b-b8b2-ce97d95e7ccb roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
50262025-08-01T16:04:47.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = aff6c664-f0c6-4e7b-b8b2-ce97d95e7ccb resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
50272025-08-01T16:04:47.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2329 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = aff6c664-f0c6-4e7b-b8b2-ce97d95e7ccb response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
50282025-08-01T16:04:48.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0f6bc222-34ad-4e74-8931-2bcfb8540f4b roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
50292025-08-01T16:04:48.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0f6bc222-34ad-4e74-8931-2bcfb8540f4b resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
50302025-08-01T16:04:48.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1546 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0f6bc222-34ad-4e74-8931-2bcfb8540f4b response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
50312025-08-01T16:04:49.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = da3b1f10-56dd-4034-9f77-5b91f7e8dcb1 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
50322025-08-01T16:04:49.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = da3b1f10-56dd-4034-9f77-5b91f7e8dcb1 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
50332025-08-01T16:04:49.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2463 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = da3b1f10-56dd-4034-9f77-5b91f7e8dcb1 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
50342025-08-01T16:04:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
50352025-08-01T16:04:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
50362025-08-01T16:04:49.688ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
50372025-08-01T16:04:49.688ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
50382025-08-01T16:04:49.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50392025-08-01T16:04:49.688ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-01 15:54:49.688180256 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
50402025-08-01T16:04:49.688ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
50412025-08-01T16:04:49.688ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
50422025-08-01T16:04:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
50432025-08-01T16:04:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
50442025-08-01T16:04:49.688ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
50452025-08-01T16:04:49.688ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50462025-08-01T16:04:49.688ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
50472025-08-01T16:04:49.688ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
50482025-08-01T16:04:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
50492025-08-01T16:04:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
50502025-08-01T16:04:49.688ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
50512025-08-01T16:04:49.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50522025-08-01T16:04:49.688ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
50532025-08-01T16:04:49.688ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50542025-08-01T16:04:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
50552025-08-01T16:04:49.688ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cb706a84-a33b-442f-aac2-3a6eb5f3b330.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d688a68d-d771-4ac5-8e66-9efa94dbbea8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d688a68d-d771-4ac5-8e66-9efa94dbbea8.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 43985, tv_nsec: 704885625 } })
50562025-08-01T16:04:49.688ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50fe31de-3241-42df-a386-de37ce323a34.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("58598327-8751-423c-a5ac-c610829651e2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 43985, tv_nsec: 704900296 } })
50572025-08-01T16:04:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50582025-08-01T16:04:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
50592025-08-01T16:04:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50602025-08-01T16:04:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50612025-08-01T16:04:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50622025-08-01T16:04:49.689ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
50632025-08-01T16:04:49.689ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.01577ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
50642025-08-01T16:04:49.689ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
50652025-08-01T16:04:49.689ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.01331ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
50662025-08-01T16:04:49.689ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50672025-08-01T16:04:49.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50682025-08-01T16:04:49.690ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-01 15:54:49.688180256 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
50692025-08-01T16:04:49.690ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.455894ms iteration = 8 status = {"expiration":"2025-08-01T15:54:49.688180256Z","pruned":[]}
50702025-08-01T16:04:49.691ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50712025-08-01T16:04:49.691ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43985, tv_nsec: 707819414 } })
50722025-08-01T16:04:49.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50732025-08-01T16:04:49.691ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43985, tv_nsec: 707940798 } })
50742025-08-01T16:04:49.691ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
50752025-08-01T16:04:49.691ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
50762025-08-01T16:04:49.692ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.209407ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
50772025-08-01T16:04:49.692ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50782025-08-01T16:04:49.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
50792025-08-01T16:04:49.707ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
50802025-08-01T16:04:49.707ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1
50812025-08-01T16:04:49.707ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 31.911\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1"}
50822025-08-01T16:04:49.709ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 11 reason = Timeout
50832025-08-01T16:04:49.709ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
50842025-08-01T16:04:49.709ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 16.401\u{b5}s iteration = 11 status = "Disabled"
50852025-08-01T16:04:49.710ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
50862025-08-01T16:04:49.710ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
50872025-08-01T16:04:49.710ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 8 reason = Timeout
50882025-08-01T16:04:49.710ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
50892025-08-01T16:04:49.710ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
50902025-08-01T16:04:49.710ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
50912025-08-01T16:04:49.710ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
50922025-08-01T16:04:49.710ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
50932025-08-01T16:04:49.710ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
50942025-08-01T16:04:49.710ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
50952025-08-01T16:04:49.710ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
50962025-08-01T16:04:49.710ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 8 reason = Timeout
50972025-08-01T16:04:49.710ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
50982025-08-01T16:04:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
50992025-08-01T16:04:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
51002025-08-01T16:04:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
51012025-08-01T16:04:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
51022025-08-01T16:04:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
51032025-08-01T16:04:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
51042025-08-01T16:04:49.718ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
51052025-08-01T16:04:49.718ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
51062025-08-01T16:04:49.718ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 7.631301ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
51072025-08-01T16:04:49.719ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51082025-08-01T16:04:49.720ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.180299ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
51092025-08-01T16:04:49.721ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
51102025-08-01T16:04:49.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
51112025-08-01T16:04:49.722ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
51122025-08-01T16:04:49.722ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 11.666664ms iteration = 8 status = {"by_rx":{},"error":null}
51132025-08-01T16:04:49.723ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
51142025-08-01T16:04:49.723ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
51152025-08-01T16:04:49.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
51162025-08-01T16:04:49.727ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 14.672275ms iteration = 8 status = {"dispatched":[],"errors":[],"glob_version":"173.0.0","globs_reprocessed":{},"no_receivers":[]}
51172025-08-01T16:04:49.741ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51182025-08-01T16:04:49.743ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51192025-08-01T16:04:49.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51202025-08-01T16:04:49.746ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
51212025-08-01T16:04:49.746ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51222025-08-01T16:04:49.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51232025-08-01T16:04:49.748ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51242025-08-01T16:04:49.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51252025-08-01T16:04:49.749ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51262025-08-01T16:04:49.753ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
51272025-08-01T16:04:49.753ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
51282025-08-01T16:04:49.753ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
51292025-08-01T16:04:49.753ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51302025-08-01T16:04:49.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51312025-08-01T16:04:49.754ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
51322025-08-01T16:04:49.754ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51332025-08-01T16:04:49.754ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51342025-08-01T16:04:49.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51352025-08-01T16:04:49.757ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51362025-08-01T16:04:49.757ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51372025-08-01T16:04:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51382025-08-01T16:04:49.758ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 15 reason = Timeout
51392025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
51402025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51412025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
51422025-08-01T16:04:49.759ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
51432025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 17.271\u{b5}s iteration = 15 status = {"disabled":true,"errors":[],"sps":[]}
51442025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 85 reason = Timeout
51452025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51462025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
51472025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
51482025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51492025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
51502025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
51512025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
51522025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
51532025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51542025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51552025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
51562025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
51572025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
51582025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
51592025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
51602025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51612025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
51622025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51632025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
51642025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
51652025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51662025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
51672025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51682025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 15 reason = Timeout
51692025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
51702025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
51712025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
51722025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51732025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51742025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
51752025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51762025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51772025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51782025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51792025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51802025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
51812025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51822025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
51832025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51842025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
51852025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51862025-08-01T16:04:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
51872025-08-01T16:04:49.760ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 15 reason = Timeout
51882025-08-01T16:04:49.760ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
51892025-08-01T16:04:49.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51902025-08-01T16:04:49.760ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
51912025-08-01T16:04:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51922025-08-01T16:04:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
51932025-08-01T16:04:49.760ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51942025-08-01T16:04:49.760ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51952025-08-01T16:04:49.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51962025-08-01T16:04:49.761ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51972025-08-01T16:04:49.761ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51982025-08-01T16:04:49.762ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51992025-08-01T16:04:49.763ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52002025-08-01T16:04:49.763ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52012025-08-01T16:04:49.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52022025-08-01T16:04:49.765ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.176588ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
52032025-08-01T16:04:49.765ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52042025-08-01T16:04:49.765ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
52052025-08-01T16:04:49.765ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52062025-08-01T16:04:49.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
52072025-08-01T16:04:49.765ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52082025-08-01T16:04:49.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52092025-08-01T16:04:49.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52102025-08-01T16:04:49.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
52112025-08-01T16:04:49.766ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52122025-08-01T16:04:49.766ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52132025-08-01T16:04:49.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
52142025-08-01T16:04:49.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52152025-08-01T16:04:49.767ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.535088ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
52162025-08-01T16:04:49.768ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52172025-08-01T16:04:49.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
52182025-08-01T16:04:49.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52192025-08-01T16:04:49.768ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52202025-08-01T16:04:49.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52212025-08-01T16:04:49.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52222025-08-01T16:04:49.769ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52232025-08-01T16:04:49.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52242025-08-01T16:04:49.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
52252025-08-01T16:04:49.774ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
52262025-08-01T16:04:49.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
52272025-08-01T16:04:49.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52282025-08-01T16:04:49.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52292025-08-01T16:04:49.774ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52302025-08-01T16:04:49.774ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52312025-08-01T16:04:49.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52322025-08-01T16:04:49.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52332025-08-01T16:04:49.774ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52342025-08-01T16:04:49.774ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52352025-08-01T16:04:49.774ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
52362025-08-01T16:04:49.774ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52372025-08-01T16:04:49.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52382025-08-01T16:04:49.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52392025-08-01T16:04:49.775ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52402025-08-01T16:04:49.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52412025-08-01T16:04:49.777ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52422025-08-01T16:04:49.777ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 43985, tv_nsec: 793864083 } })
52432025-08-01T16:04:49.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52442025-08-01T16:04:49.778ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
52452025-08-01T16:04:49.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52462025-08-01T16:04:49.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52472025-08-01T16:04:49.779ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52482025-08-01T16:04:49.781ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
52492025-08-01T16:04:49.781ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
52502025-08-01T16:04:49.781ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 70.613701ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
52512025-08-01T16:04:49.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52522025-08-01T16:04:49.782ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52532025-08-01T16:04:49.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52542025-08-01T16:04:49.792ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
52552025-08-01T16:04:49.792ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 33.198817ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
52562025-08-01T16:04:49.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52572025-08-01T16:04:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
52582025-08-01T16:04:49.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52592025-08-01T16:04:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52602025-08-01T16:04:49.813ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
52612025-08-01T16:04:49.813ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
52622025-08-01T16:04:49.813ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
52632025-08-01T16:04:49.813ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52642025-08-01T16:04:49.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52652025-08-01T16:04:49.816ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52662025-08-01T16:04:49.816ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52672025-08-01T16:04:49.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52682025-08-01T16:04:49.818ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
52692025-08-01T16:04:49.818ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52702025-08-01T16:04:49.818ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "818dbd01-7d19-4fe2-8637-4447ccbdbd33", "content-length": "26", "date": "Fri, 01 Aug 2025 16:04:49 GMT"} })
52712025-08-01T16:04:49.818ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52722025-08-01T16:04:49.819ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52732025-08-01T16:04:49.820ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52742025-08-01T16:04:49.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
52752025-08-01T16:04:49.822ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52762025-08-01T16:04:49.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52772025-08-01T16:04:49.823ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
52782025-08-01T16:04:49.823ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
52792025-08-01T16:04:49.823ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52802025-08-01T16:04:49.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52812025-08-01T16:04:49.825ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52822025-08-01T16:04:49.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52832025-08-01T16:04:49.827ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
52842025-08-01T16:04:49.827ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 67.569978ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
52852025-08-01T16:04:49.829ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.820477ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52862025-08-01T16:04:49.833ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
52872025-08-01T16:04:49.833ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 02fcb774-aa43-4052-9996-b85e2d1358b5 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
52882025-08-01T16:04:49.833ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52892025-08-01T16:04:49.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52902025-08-01T16:04:49.837ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52912025-08-01T16:04:49.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52922025-08-01T16:04:49.841ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52932025-08-01T16:04:49.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52942025-08-01T16:04:49.848ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52952025-08-01T16:04:49.848ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
52962025-08-01T16:04:49.849ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
52972025-08-01T16:04:49.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
52982025-08-01T16:04:49.853ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 02fcb774-aa43-4052-9996-b85e2d1358b5 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
52992025-08-01T16:04:49.853ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
53002025-08-01T16:04:49.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53012025-08-01T16:04:49.853ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-01 15:58:34.032744 UTC dns_group = internal generation = 1
53022025-08-01T16:04:49.853ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 164.934861ms iteration = 8 status = {"generation":1}
53032025-08-01T16:04:49.853ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 94.234427ms iteration = 15 status = {"errors":[],"requests_created_ok":[]}
53042025-08-01T16:04:49.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 94.592439ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
53052025-08-01T16:04:49.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53062025-08-01T16:04:49.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
53072025-08-01T16:04:49.854ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
53082025-08-01T16:04:49.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
53092025-08-01T16:04:49.857ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53102025-08-01T16:04:49.858ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
53112025-08-01T16:04:49.858ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 99.353063ms iteration = 85 status = {"chicken_switches_updated":false}
53122025-08-01T16:04:49.858ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 99.369233ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
53132025-08-01T16:04:49.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
53142025-08-01T16:04:49.861ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
53152025-08-01T16:04:49.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
53162025-08-01T16:04:49.865ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53172025-08-01T16:04:49.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53182025-08-01T16:04:49.867ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53192025-08-01T16:04:49.867ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
53202025-08-01T16:04:49.867ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 107.989664ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
53212025-08-01T16:04:49.879ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53222025-08-01T16:04:49.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53232025-08-01T16:04:49.882ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53242025-08-01T16:04:49.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53252025-08-01T16:04:49.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53262025-08-01T16:04:49.885ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
53272025-08-01T16:04:49.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
53282025-08-01T16:04:49.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
53292025-08-01T16:04:49.890ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53302025-08-01T16:04:49.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53312025-08-01T16:04:49.893ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 133.977772ms iteration = 15 status = 0
53322025-08-01T16:04:49.896ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
53332025-08-01T16:04:49.896ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53342025-08-01T16:04:49.897ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfe429c9-9a6f-4a61-b8dd-f75d83fe06da", "content-length": "26", "date": "Fri, 01 Aug 2025 16:04:49 GMT"} })
53352025-08-01T16:04:49.897ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53362025-08-01T16:04:49.898ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53372025-08-01T16:04:49.912ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:391
53382025-08-01T16:04:49.912ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 152.543856ms iteration = 15 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
53392025-08-01T16:04:49.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 727 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = c606374a-98d1-4c6b-8516-35e7869868c9 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
53402025-08-01T16:04:49.922ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-01T15:57:44.766264Z, time_modified: 2025-08-01T15:57:44.766264Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: eec17da7-eb17-4917-8728-908698b69bbe, db_silo: Silo { identity: SiloIdentity { id: eec17da7-eb17-4917-8728-908698b69bbe, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-01T15:58:34.653875Z, time_modified: 2025-08-01T15:58:34.653875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: eec17da7-eb17-4917-8728-908698b69bbe, db_silo: Silo { identity: SiloIdentity { id: eec17da7-eb17-4917-8728-908698b69bbe, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-01T15:58:34.653875Z, time_modified: 2025-08-01T15:58:34.653875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575" }] }) }
53412025-08-01T16:04:49.922ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 233.963934ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"eec17da7-eb17-4917-8728-908698b69bbe","tls_certs":["b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575"]}},"default_endpoint":{"silo_id":"eec17da7-eb17-4917-8728-908698b69bbe","tls_certs":["b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
53422025-08-01T16:04:49.922ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 163.55065ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
53432025-08-01T16:04:49.924ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
53442025-08-01T16:04:49.925ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6482e44c-c860-4033-b945-5707d343a59d dns_zone_name = oxide.test found_so_far = 0 version = 2
53452025-08-01T16:04:49.925ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53462025-08-01T16:04:49.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53472025-08-01T16:04:49.927ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53482025-08-01T16:04:49.932ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
53492025-08-01T16:04:49.932ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53502025-08-01T16:04:49.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53512025-08-01T16:04:49.934ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6482e44c-c860-4033-b945-5707d343a59d dns_zone_name = oxide.test found_so_far = 4 version = 2
53522025-08-01T16:04:49.934ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
53532025-08-01T16:04:49.934ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-01 15:58:34.713515 UTC dns_group = external generation = 2
53542025-08-01T16:04:49.934ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 246.572236ms iteration = 8 status = {"generation":2}
53552025-08-01T16:04:49.949ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53562025-08-01T16:04:49.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53572025-08-01T16:04:49.982ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53582025-08-01T16:04:49.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53592025-08-01T16:04:49.985ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 296.775399ms iteration = 15 status = null
53602025-08-01T16:04:49.992ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 233.121539ms iteration = 17 status = {"physical_disks_added":0}
53612025-08-01T16:04:49.998ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
53622025-08-01T16:04:49.999ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "50b7197c-6be0-46dd-9f92-32058514d733", "date": "Fri, 01 Aug 2025 16:04:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
53632025-08-01T16:04:49.999ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
53642025-08-01T16:04:50.000ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b41adcef-4e62-4ee5-a625-1e48306b0cc8", "date": "Fri, 01 Aug 2025 16:04:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
53652025-08-01T16:04:50.000ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
53662025-08-01T16:04:50.002ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
53672025-08-01T16:04:50.002ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 314.31563ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
53682025-08-01T16:04:50.002ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53692025-08-01T16:04:50.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53702025-08-01T16:04:50.005ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53712025-08-01T16:04:50.007ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53722025-08-01T16:04:50.007ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53732025-08-01T16:04:50.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53742025-08-01T16:04:50.009ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53752025-08-01T16:04:50.011ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53762025-08-01T16:04:50.011ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53772025-08-01T16:04:50.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53782025-08-01T16:04:50.029ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
53792025-08-01T16:04:50.033ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 345.316301ms iteration = 15 status = {}
53802025-08-01T16:04:50.037ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 zone_address = fd00:1122:3344:101::2
53812025-08-01T16:04:50.037ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53822025-08-01T16:04:50.037ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "daac0735-6c03-41f3-bed1-8643fb78dbd5", "content-length": "26", "date": "Fri, 01 Aug 2025 16:04:49 GMT"} })
53832025-08-01T16:04:50.037ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53842025-08-01T16:04:50.040ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
53852025-08-01T16:04:50.055ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
53862025-08-01T16:04:50.055ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 345.109724ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
53872025-08-01T16:04:50.065ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
53882025-08-01T16:04:50.065ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53892025-08-01T16:04:50.066ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "aaf91187-71bc-45aa-971e-1ca46f8f2a55", "content-length": "372", "date": "Fri, 01 Aug 2025 16:04:49 GMT"} })
53902025-08-01T16:04:50.066ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53912025-08-01T16:04:50.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53922025-08-01T16:04:50.079ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
53932025-08-01T16:04:50.080ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e1a6fefc-0ba8-4606-b664-1a25fa235596", "date": "Fri, 01 Aug 2025 16:04:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
53942025-08-01T16:04:50.080ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
53952025-08-01T16:04:50.082ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "436cf858-c6b9-49b3-87f9-d31808f5779f", "date": "Fri, 01 Aug 2025 16:04:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
53962025-08-01T16:04:50.082ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
53972025-08-01T16:04:50.085ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "c9f27a2e-f38b-4ff6-a6a5-938a756cd9e7", "date": "Fri, 01 Aug 2025 16:04:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
53982025-08-01T16:04:50.085ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
53992025-08-01T16:04:50.087ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
54002025-08-01T16:04:50.087ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 399.37854ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
54012025-08-01T16:04:50.119ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
54022025-08-01T16:04:50.119ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
54032025-08-01T16:04:50.119ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6c2c15bd-b605-44f0-b55d-e630b0e6be15", "date": "Fri, 01 Aug 2025 16:04:49 GMT"} })
54042025-08-01T16:04:50.119ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54052025-08-01T16:04:50.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54062025-08-01T16:04:50.123ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54072025-08-01T16:04:50.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54082025-08-01T16:04:50.126ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54092025-08-01T16:04:50.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54102025-08-01T16:04:50.129ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
54112025-08-01T16:04:50.129ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54122025-08-01T16:04:50.130ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b0e138e7-19af-4461-bcdf-1109001c9c4d", "date": "Fri, 01 Aug 2025 16:04:50 GMT"} })
54132025-08-01T16:04:50.131ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 372.623878ms iteration = 15 status = {}
54142025-08-01T16:04:50.158ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
54152025-08-01T16:04:50.158ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "87d87407-cf67-4b58-a601-c489b0f82cf7", "content-length": "691", "date": "Fri, 01 Aug 2025 16:04:49 GMT"} })
54162025-08-01T16:04:50.158ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
54172025-08-01T16:04:50.158ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
54182025-08-01T16:04:50.158ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
54192025-08-01T16:04:50.160ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 401.01846ms iteration = 15 status = {}
54202025-08-01T16:04:50.174ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54212025-08-01T16:04:50.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54222025-08-01T16:04:50.176ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 3f21d9d5-3adf-463a-a05d-bc2e2e5d64ca, rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(4c7da70d-ede0-4107-abc5-5650a053be38) } rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
54232025-08-01T16:04:50.176ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54242025-08-01T16:04:50.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54252025-08-01T16:04:50.189ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
54262025-08-01T16:04:50.189ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 4c7da70d-ede0-4107-abc5-5650a053be38
54272025-08-01T16:04:50.190ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
54282025-08-01T16:04:50.190ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
54292025-08-01T16:04:50.190ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54302025-08-01T16:04:50.190ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54312025-08-01T16:04:50.190ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54322025-08-01T16:04:50.190ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
54332025-08-01T16:04:50.190ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54342025-08-01T16:04:50.190ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
54352025-08-01T16:04:50.190ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
54362025-08-01T16:04:50.190ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54372025-08-01T16:04:50.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54382025-08-01T16:04:50.192ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
54392025-08-01T16:04:50.193ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
54402025-08-01T16:04:50.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6896e3ba-87fd-4ee8-9c19-299de79615d3 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54412025-08-01T16:04:50.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6896e3ba-87fd-4ee8-9c19-299de79615d3 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54422025-08-01T16:04:50.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2251 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6896e3ba-87fd-4ee8-9c19-299de79615d3 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54432025-08-01T16:04:50.349ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1e6bfc54-fd1e-4769-b5ab-5bfadf946c9b", "date": "Fri, 01 Aug 2025 16:04:49 GMT"} })
54442025-08-01T16:04:50.349ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch = Switch0
54452025-08-01T16:04:50.349ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
54462025-08-01T16:04:50.350ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e0b9362-4825-4aca-abfc-a37b07c32eca", "content-length": "682", "date": "Fri, 01 Aug 2025 16:04:50 GMT"} })
54472025-08-01T16:04:50.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54482025-08-01T16:04:50.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54492025-08-01T16:04:50.353ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54502025-08-01T16:04:50.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54512025-08-01T16:04:50.356ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54522025-08-01T16:04:50.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54532025-08-01T16:04:50.358ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54542025-08-01T16:04:50.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54552025-08-01T16:04:50.365ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 606.123658ms iteration = 15 status = {}
54562025-08-01T16:04:51.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 93be47ba-10a7-4c9b-a379-389b9b089199 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54572025-08-01T16:04:51.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 93be47ba-10a7-4c9b-a379-389b9b089199 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54582025-08-01T16:04:51.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2057 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 93be47ba-10a7-4c9b-a379-389b9b089199 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54592025-08-01T16:04:52.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9cbff0fa-7c19-4ca0-868e-7d31b92dc4a6 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54602025-08-01T16:04:52.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9cbff0fa-7c19-4ca0-868e-7d31b92dc4a6 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54612025-08-01T16:04:52.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1873 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9cbff0fa-7c19-4ca0-868e-7d31b92dc4a6 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54622025-08-01T16:04:53.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2c320790-09ec-44aa-b09e-9365f5a16664 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54632025-08-01T16:04:53.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2c320790-09ec-44aa-b09e-9365f5a16664 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54642025-08-01T16:04:53.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2553 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2c320790-09ec-44aa-b09e-9365f5a16664 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54652025-08-01T16:04:54.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cc380010-3392-4260-a604-ada6012a284f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54662025-08-01T16:04:54.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cc380010-3392-4260-a604-ada6012a284f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54672025-08-01T16:04:54.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2378 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cc380010-3392-4260-a604-ada6012a284f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54682025-08-01T16:04:54.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 86 reason = Timeout
54692025-08-01T16:04:54.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
54702025-08-01T16:04:54.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
54712025-08-01T16:04:54.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54722025-08-01T16:04:54.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
54732025-08-01T16:04:54.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
54742025-08-01T16:04:54.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
54752025-08-01T16:04:54.767ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
54762025-08-01T16:04:54.767ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.312052ms iteration = 86 status = {"chicken_switches_updated":false}
54772025-08-01T16:04:55.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 535dbfa8-281d-438d-adf7-c77c6689a92b roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54782025-08-01T16:04:55.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 535dbfa8-281d-438d-adf7-c77c6689a92b resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54792025-08-01T16:04:55.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1911 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 535dbfa8-281d-438d-adf7-c77c6689a92b response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54802025-08-01T16:04:56.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 004599f6-0d85-48ec-87eb-b877999e8583 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54812025-08-01T16:04:56.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 004599f6-0d85-48ec-87eb-b877999e8583 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54822025-08-01T16:04:56.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 4404 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 004599f6-0d85-48ec-87eb-b877999e8583 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54832025-08-01T16:04:57.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 818b90cf-6d51-4113-bb5e-43d1fa7e096e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54842025-08-01T16:04:57.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 818b90cf-6d51-4113-bb5e-43d1fa7e096e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54852025-08-01T16:04:57.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2180 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 818b90cf-6d51-4113-bb5e-43d1fa7e096e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54862025-08-01T16:04:58.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f8976b41-89a3-4bf4-b5ac-2208ce9467cf roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54872025-08-01T16:04:58.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f8976b41-89a3-4bf4-b5ac-2208ce9467cf resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54882025-08-01T16:04:58.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2683 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f8976b41-89a3-4bf4-b5ac-2208ce9467cf response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54892025-08-01T16:04:59.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1acb253b-e3ce-4110-b68f-08b57ef3cc47 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54902025-08-01T16:04:59.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1acb253b-e3ce-4110-b68f-08b57ef3cc47 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54912025-08-01T16:04:59.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2230 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1acb253b-e3ce-4110-b68f-08b57ef3cc47 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
54922025-08-01T16:04:59.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
54932025-08-01T16:04:59.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 87 reason = Timeout
54942025-08-01T16:04:59.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54952025-08-01T16:04:59.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
54962025-08-01T16:04:59.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54972025-08-01T16:04:59.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
54982025-08-01T16:04:59.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
54992025-08-01T16:04:59.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55002025-08-01T16:04:59.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55012025-08-01T16:04:59.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55022025-08-01T16:04:59.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55032025-08-01T16:04:59.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55042025-08-01T16:04:59.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55052025-08-01T16:04:59.764ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.231019ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55062025-08-01T16:04:59.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
55072025-08-01T16:04:59.765ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
55082025-08-01T16:04:59.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
55092025-08-01T16:04:59.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55102025-08-01T16:04:59.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55112025-08-01T16:04:59.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55122025-08-01T16:04:59.767ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
55132025-08-01T16:04:59.767ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.694334ms iteration = 87 status = {"chicken_switches_updated":false}
55142025-08-01T16:04:59.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55152025-08-01T16:04:59.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55162025-08-01T16:04:59.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55172025-08-01T16:04:59.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
55182025-08-01T16:04:59.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55192025-08-01T16:04:59.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55202025-08-01T16:04:59.786ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
55212025-08-01T16:04:59.786ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.537245ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
55222025-08-01T16:04:59.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50110 req_id = 9a7bcbef-41f7-4941-ab76-125792f1014e roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
55232025-08-01T16:04:59.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50110 req_id = 9a7bcbef-41f7-4941-ab76-125792f1014e resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
55242025-08-01T16:04:59.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2255 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50110 req_id = 9a7bcbef-41f7-4941-ab76-125792f1014e response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
55252025-08-01T16:04:59.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50110 req_id = f8f531b6-cc0f-4c1c-8ac6-5dcd22ba9152 roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
55262025-08-01T16:04:59.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50110 req_id = f8f531b6-cc0f-4c1c-8ac6-5dcd22ba9152 resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
55272025-08-01T16:04:59.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1993 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50110 req_id = f8f531b6-cc0f-4c1c-8ac6-5dcd22ba9152 response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
55282025-08-01T16:04:59.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 476 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 8cd1bf45-f647-4c9c-8c5c-5869fdaaeed5 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
55292025-08-01T16:05:00.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a55cd3c9-88e0-4773-bcf8-feef9ff55a3a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55302025-08-01T16:05:00.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a55cd3c9-88e0-4773-bcf8-feef9ff55a3a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55312025-08-01T16:05:00.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1688 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a55cd3c9-88e0-4773-bcf8-feef9ff55a3a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55322025-08-01T16:05:01.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 57031d7b-e5ec-4ea8-a5f7-03f086dda0f0 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55332025-08-01T16:05:01.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 57031d7b-e5ec-4ea8-a5f7-03f086dda0f0 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55342025-08-01T16:05:01.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2355 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 57031d7b-e5ec-4ea8-a5f7-03f086dda0f0 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55352025-08-01T16:05:02.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 19703328-4744-4e76-9eb3-00e21ea39d92 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55362025-08-01T16:05:02.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 19703328-4744-4e76-9eb3-00e21ea39d92 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55372025-08-01T16:05:02.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2557 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 19703328-4744-4e76-9eb3-00e21ea39d92 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55382025-08-01T16:05:03.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dd417211-de8d-4c83-ae57-a186d8026238 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55392025-08-01T16:05:03.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dd417211-de8d-4c83-ae57-a186d8026238 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55402025-08-01T16:05:03.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2308 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dd417211-de8d-4c83-ae57-a186d8026238 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55412025-08-01T16:05:04.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2daf467c-cc79-444b-8b53-8b50a3495171 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55422025-08-01T16:05:04.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2daf467c-cc79-444b-8b53-8b50a3495171 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55432025-08-01T16:05:04.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1992 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2daf467c-cc79-444b-8b53-8b50a3495171 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55442025-08-01T16:05:04.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 88 reason = Timeout
55452025-08-01T16:05:04.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
55462025-08-01T16:05:04.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
55472025-08-01T16:05:04.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55482025-08-01T16:05:04.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
55492025-08-01T16:05:04.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
55502025-08-01T16:05:04.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
55512025-08-01T16:05:04.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
55522025-08-01T16:05:04.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.498087ms iteration = 88 status = {"chicken_switches_updated":false}
55532025-08-01T16:05:05.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 61bb6ebe-2c40-4276-b1df-a77862b30f89 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55542025-08-01T16:05:05.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 61bb6ebe-2c40-4276-b1df-a77862b30f89 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55552025-08-01T16:05:05.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2083 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 61bb6ebe-2c40-4276-b1df-a77862b30f89 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55562025-08-01T16:05:06.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9b3ad14d-9cdb-4d80-88c4-c202211cd52c roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55572025-08-01T16:05:06.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9b3ad14d-9cdb-4d80-88c4-c202211cd52c resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55582025-08-01T16:05:06.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2430 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9b3ad14d-9cdb-4d80-88c4-c202211cd52c response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55592025-08-01T16:05:07.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fde964c6-3fd2-4fc3-b7f5-7b86c644dfc8 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55602025-08-01T16:05:07.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fde964c6-3fd2-4fc3-b7f5-7b86c644dfc8 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55612025-08-01T16:05:07.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2759 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fde964c6-3fd2-4fc3-b7f5-7b86c644dfc8 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55622025-08-01T16:05:08.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c39fd824-29f8-497b-940e-1acb372d7be8 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55632025-08-01T16:05:08.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c39fd824-29f8-497b-940e-1acb372d7be8 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55642025-08-01T16:05:08.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2231 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c39fd824-29f8-497b-940e-1acb372d7be8 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55652025-08-01T16:05:09.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 360c7a2d-d40f-41ff-a4ce-0c087b767951 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55662025-08-01T16:05:09.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 360c7a2d-d40f-41ff-a4ce-0c087b767951 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55672025-08-01T16:05:09.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2341 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 360c7a2d-d40f-41ff-a4ce-0c087b767951 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
55682025-08-01T16:05:09.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
55692025-08-01T16:05:09.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 89 reason = Timeout
55702025-08-01T16:05:09.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55712025-08-01T16:05:09.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
55722025-08-01T16:05:09.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
55732025-08-01T16:05:09.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55742025-08-01T16:05:09.760ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
55752025-08-01T16:05:09.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55762025-08-01T16:05:09.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55772025-08-01T16:05:09.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55782025-08-01T16:05:09.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55792025-08-01T16:05:09.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55802025-08-01T16:05:09.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55812025-08-01T16:05:09.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
55822025-08-01T16:05:09.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
55832025-08-01T16:05:09.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
55842025-08-01T16:05:09.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55852025-08-01T16:05:09.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55862025-08-01T16:05:09.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55872025-08-01T16:05:09.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
55882025-08-01T16:05:09.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.841568ms iteration = 89 status = {"chicken_switches_updated":false}
55892025-08-01T16:05:09.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55902025-08-01T16:05:09.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55912025-08-01T16:05:09.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55922025-08-01T16:05:09.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
55932025-08-01T16:05:09.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55942025-08-01T16:05:09.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55952025-08-01T16:05:09.792ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
55962025-08-01T16:05:09.792ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 32.034421ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
55972025-08-01T16:05:09.799ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.417285ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55982025-08-01T16:05:09.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 598 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = d87625f4-a1a0-41bd-8061-ad99cf068635 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
55992025-08-01T16:05:10.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 60f8a7bd-9e01-4b23-8987-28e124018cee roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56002025-08-01T16:05:10.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 60f8a7bd-9e01-4b23-8987-28e124018cee resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56012025-08-01T16:05:10.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1524 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 60f8a7bd-9e01-4b23-8987-28e124018cee response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56022025-08-01T16:05:11.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = be3af452-51b7-42a0-96cb-c933e97668be roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56032025-08-01T16:05:11.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = be3af452-51b7-42a0-96cb-c933e97668be resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56042025-08-01T16:05:11.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2021 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = be3af452-51b7-42a0-96cb-c933e97668be response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56052025-08-01T16:05:12.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7547bb3e-82a1-4b47-8806-117492b340e4 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56062025-08-01T16:05:12.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7547bb3e-82a1-4b47-8806-117492b340e4 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56072025-08-01T16:05:12.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2489 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7547bb3e-82a1-4b47-8806-117492b340e4 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56082025-08-01T16:05:13.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7111693e-4a1b-4433-8a27-c8d933c60d53 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56092025-08-01T16:05:13.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7111693e-4a1b-4433-8a27-c8d933c60d53 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56102025-08-01T16:05:13.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2345 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7111693e-4a1b-4433-8a27-c8d933c60d53 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56112025-08-01T16:05:14.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c6fa1999-0730-4d21-b81a-dff889e1d9ef roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56122025-08-01T16:05:14.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c6fa1999-0730-4d21-b81a-dff889e1d9ef resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56132025-08-01T16:05:14.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1905 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c6fa1999-0730-4d21-b81a-dff889e1d9ef response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56142025-08-01T16:05:14.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 90 reason = Timeout
56152025-08-01T16:05:14.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
56162025-08-01T16:05:14.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
56172025-08-01T16:05:14.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56182025-08-01T16:05:14.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
56192025-08-01T16:05:14.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
56202025-08-01T16:05:14.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
56212025-08-01T16:05:14.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
56222025-08-01T16:05:14.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.221409ms iteration = 90 status = {"chicken_switches_updated":false}
56232025-08-01T16:05:15.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a753e2e0-07e8-43bd-8b80-bd69419d39e4 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56242025-08-01T16:05:15.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a753e2e0-07e8-43bd-8b80-bd69419d39e4 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56252025-08-01T16:05:15.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2328 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a753e2e0-07e8-43bd-8b80-bd69419d39e4 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56262025-08-01T16:05:16.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 17892f9f-11e5-461d-b04c-e0c923a587ac roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56272025-08-01T16:05:16.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 17892f9f-11e5-461d-b04c-e0c923a587ac resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56282025-08-01T16:05:16.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2486 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 17892f9f-11e5-461d-b04c-e0c923a587ac response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56292025-08-01T16:05:17.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c707596f-643a-4d31-a8a7-3939a5467519 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56302025-08-01T16:05:17.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c707596f-643a-4d31-a8a7-3939a5467519 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56312025-08-01T16:05:17.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2105 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c707596f-643a-4d31-a8a7-3939a5467519 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56322025-08-01T16:05:18.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7100a8ee-4fb0-48fa-91fb-d37c9e02a3e1 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56332025-08-01T16:05:18.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7100a8ee-4fb0-48fa-91fb-d37c9e02a3e1 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56342025-08-01T16:05:18.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1851 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7100a8ee-4fb0-48fa-91fb-d37c9e02a3e1 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56352025-08-01T16:05:19.687ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
56362025-08-01T16:05:19.687ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
56372025-08-01T16:05:19.687ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56382025-08-01T16:05:19.687ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
56392025-08-01T16:05:19.687ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
56402025-08-01T16:05:19.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56412025-08-01T16:05:19.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
56422025-08-01T16:05:19.689ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44015, tv_nsec: 706160439 } })
56432025-08-01T16:05:19.690ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
56442025-08-01T16:05:19.690ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44015, tv_nsec: 706785698 } })
56452025-08-01T16:05:19.690ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
56462025-08-01T16:05:19.691ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.161236ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
56472025-08-01T16:05:19.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1194ca1f-47d8-4641-a3ad-4740ade57cfa roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56482025-08-01T16:05:19.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1194ca1f-47d8-4641-a3ad-4740ade57cfa resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56492025-08-01T16:05:19.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2057 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1194ca1f-47d8-4641-a3ad-4740ade57cfa response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
56502025-08-01T16:05:19.727ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
56512025-08-01T16:05:19.727ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56522025-08-01T16:05:19.727ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "42409cd6-fa2a-43f2-961f-b6dcdf095de7", "content-length": "26", "date": "Fri, 01 Aug 2025 16:05:19 GMT"} })
56532025-08-01T16:05:19.727ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56542025-08-01T16:05:19.727ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
56552025-08-01T16:05:19.727ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56562025-08-01T16:05:19.727ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7faac0c-e158-4dcd-b7dc-d651e73fc15b", "content-length": "26", "date": "Fri, 01 Aug 2025 16:05:19 GMT"} })
56572025-08-01T16:05:19.727ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56582025-08-01T16:05:19.728ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56592025-08-01T16:05:19.729ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56602025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 16 reason = Timeout
56612025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 12.051\u{b5}s iteration = 16 status = {"disabled":true,"errors":[],"sps":[]}
56622025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
56632025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
56642025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
56652025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 16 reason = Timeout
56662025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56672025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
56682025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
56692025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
56702025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
56712025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
56722025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
56732025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56742025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56752025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
56762025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
56772025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
56782025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56792025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
56802025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56812025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
56822025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
56832025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
56842025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
56852025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 91 reason = Timeout
56862025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
56872025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
56882025-08-01T16:05:19.758ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
56892025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56902025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
56912025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56922025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
56932025-08-01T16:05:19.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56942025-08-01T16:05:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56952025-08-01T16:05:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
56962025-08-01T16:05:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56972025-08-01T16:05:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
56982025-08-01T16:05:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
56992025-08-01T16:05:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57002025-08-01T16:05:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57012025-08-01T16:05:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
57022025-08-01T16:05:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57032025-08-01T16:05:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
57042025-08-01T16:05:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57052025-08-01T16:05:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57062025-08-01T16:05:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57072025-08-01T16:05:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57082025-08-01T16:05:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57092025-08-01T16:05:19.760ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 16 reason = Timeout
57102025-08-01T16:05:19.760ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
57112025-08-01T16:05:19.760ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
57122025-08-01T16:05:19.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57132025-08-01T16:05:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
57142025-08-01T16:05:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57152025-08-01T16:05:19.762ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57162025-08-01T16:05:19.763ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57172025-08-01T16:05:19.764ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57182025-08-01T16:05:19.765ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57192025-08-01T16:05:19.765ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
57202025-08-01T16:05:19.765ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57212025-08-01T16:05:19.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57222025-08-01T16:05:19.768ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57232025-08-01T16:05:19.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
57242025-08-01T16:05:19.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57252025-08-01T16:05:19.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57262025-08-01T16:05:19.768ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57272025-08-01T16:05:19.768ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57282025-08-01T16:05:19.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57292025-08-01T16:05:19.769ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57302025-08-01T16:05:19.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
57312025-08-01T16:05:19.769ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57322025-08-01T16:05:19.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57332025-08-01T16:05:19.770ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57342025-08-01T16:05:19.772ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57352025-08-01T16:05:19.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57362025-08-01T16:05:19.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
57372025-08-01T16:05:19.772ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
57382025-08-01T16:05:19.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
57392025-08-01T16:05:19.772ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57402025-08-01T16:05:19.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
57412025-08-01T16:05:19.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57422025-08-01T16:05:19.773ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57432025-08-01T16:05:19.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57442025-08-01T16:05:19.774ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57452025-08-01T16:05:19.774ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
57462025-08-01T16:05:19.774ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57472025-08-01T16:05:19.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57482025-08-01T16:05:19.774ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57492025-08-01T16:05:19.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57502025-08-01T16:05:19.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57512025-08-01T16:05:19.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
57522025-08-01T16:05:19.775ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
57532025-08-01T16:05:19.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
57542025-08-01T16:05:19.776ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
57552025-08-01T16:05:19.776ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 17.176771ms iteration = 91 status = {"chicken_switches_updated":false}
57562025-08-01T16:05:19.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57572025-08-01T16:05:19.777ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57582025-08-01T16:05:19.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57592025-08-01T16:05:19.778ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
57602025-08-01T16:05:19.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
57612025-08-01T16:05:19.780ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57622025-08-01T16:05:19.781ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57632025-08-01T16:05:19.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57642025-08-01T16:05:19.781ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44015, tv_nsec: 798085036 } })
57652025-08-01T16:05:19.781ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57662025-08-01T16:05:19.782ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
57672025-08-01T16:05:19.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57682025-08-01T16:05:19.782ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57692025-08-01T16:05:19.782ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57702025-08-01T16:05:19.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57712025-08-01T16:05:19.784ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57722025-08-01T16:05:19.784ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57732025-08-01T16:05:19.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57742025-08-01T16:05:19.787ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
57752025-08-01T16:05:19.787ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57762025-08-01T16:05:19.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57772025-08-01T16:05:19.811ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
57782025-08-01T16:05:19.811ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.322956ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
57792025-08-01T16:05:19.815ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 127.698232ms iteration = 16 status = {}
57802025-08-01T16:05:19.816ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57812025-08-01T16:05:19.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57822025-08-01T16:05:19.816ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57832025-08-01T16:05:19.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57842025-08-01T16:05:19.818ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 60.206836ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
57852025-08-01T16:05:19.820ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57862025-08-01T16:05:19.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57872025-08-01T16:05:19.822ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 63.363311ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
57882025-08-01T16:05:19.822ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 63.586238ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
57892025-08-01T16:05:19.823ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 135.921962ms iteration = 16 status = null
57902025-08-01T16:05:19.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57912025-08-01T16:05:19.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57922025-08-01T16:05:19.825ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.513617ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57932025-08-01T16:05:19.827ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57942025-08-01T16:05:19.827ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 68.714303ms iteration = 16 status = {"errors":[],"requests_created_ok":[]}
57952025-08-01T16:05:19.827ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57962025-08-01T16:05:19.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57972025-08-01T16:05:19.830ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57982025-08-01T16:05:19.830ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
57992025-08-01T16:05:19.830ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 71.675513ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
58002025-08-01T16:05:19.830ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58012025-08-01T16:05:19.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58022025-08-01T16:05:19.830ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58032025-08-01T16:05:19.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58042025-08-01T16:05:19.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58052025-08-01T16:05:19.831ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58062025-08-01T16:05:19.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58072025-08-01T16:05:19.832ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58082025-08-01T16:05:19.833ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58092025-08-01T16:05:19.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58102025-08-01T16:05:19.836ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
58112025-08-01T16:05:19.836ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 77.487459ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
58122025-08-01T16:05:19.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
58132025-08-01T16:05:19.837ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58142025-08-01T16:05:19.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58152025-08-01T16:05:19.838ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58162025-08-01T16:05:19.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
58172025-08-01T16:05:19.840ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
58182025-08-01T16:05:19.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
58192025-08-01T16:05:19.845ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 86.531504ms iteration = 16 status = 0
58202025-08-01T16:05:19.845ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:391
58212025-08-01T16:05:19.845ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 85.10355ms iteration = 16 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
58222025-08-01T16:05:19.878ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 zone_address = fd00:1122:3344:101::2
58232025-08-01T16:05:19.878ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58242025-08-01T16:05:19.878ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5944cac-6cea-49e4-8773-a5fef6f6966a", "content-length": "26", "date": "Fri, 01 Aug 2025 16:05:19 GMT"} })
58252025-08-01T16:05:19.878ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58262025-08-01T16:05:19.880ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
58272025-08-01T16:05:19.887ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 128.719352ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
58282025-08-01T16:05:19.888ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
58292025-08-01T16:05:19.888ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58302025-08-01T16:05:19.888ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b4f6d39-5e48-4f8e-b406-6e13450e97f6", "content-length": "372", "date": "Fri, 01 Aug 2025 16:05:19 GMT"} })
58312025-08-01T16:05:19.888ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58322025-08-01T16:05:19.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58332025-08-01T16:05:19.894ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 135.927422ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
58342025-08-01T16:05:19.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 757 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = a4b0228b-602f-4cd9-808b-3136b9ad3be1 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
58352025-08-01T16:05:19.957ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
58362025-08-01T16:05:19.957ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
58372025-08-01T16:05:19.958ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58382025-08-01T16:05:19.958ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cbad00c3-ea9b-49e3-abbc-44ba9e28f5fd", "date": "Fri, 01 Aug 2025 16:05:19 GMT"} })
58392025-08-01T16:05:19.958ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58402025-08-01T16:05:19.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58412025-08-01T16:05:19.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58422025-08-01T16:05:19.960ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58432025-08-01T16:05:19.962ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58442025-08-01T16:05:19.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58452025-08-01T16:05:19.963ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58462025-08-01T16:05:19.963ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58472025-08-01T16:05:19.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58482025-08-01T16:05:19.969ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58492025-08-01T16:05:19.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58502025-08-01T16:05:19.971ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58512025-08-01T16:05:19.974ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58522025-08-01T16:05:19.974ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58532025-08-01T16:05:19.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58542025-08-01T16:05:19.976ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
58552025-08-01T16:05:19.976ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58562025-08-01T16:05:19.977ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "85661732-51ff-45fd-b7d9-dc33b680ab26", "date": "Fri, 01 Aug 2025 16:05:19 GMT"} })
58572025-08-01T16:05:19.979ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 220.64701ms iteration = 16 status = {}
58582025-08-01T16:05:19.993ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 234.288354ms iteration = 18 status = {"physical_disks_added":0}
58592025-08-01T16:05:20.047ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58602025-08-01T16:05:20.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58612025-08-01T16:05:20.047ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
58622025-08-01T16:05:20.049ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 3f21d9d5-3adf-463a-a05d-bc2e2e5d64ca, rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(4c7da70d-ede0-4107-abc5-5650a053be38) } rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
58632025-08-01T16:05:20.049ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58642025-08-01T16:05:20.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58652025-08-01T16:05:20.050ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "515c020e-85c5-484f-9617-43b75153aa4f", "content-length": "691", "date": "Fri, 01 Aug 2025 16:05:19 GMT"} })
58662025-08-01T16:05:20.050ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
58672025-08-01T16:05:20.050ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
58682025-08-01T16:05:20.050ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
58692025-08-01T16:05:20.052ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 293.83978ms iteration = 16 status = {}
58702025-08-01T16:05:20.062ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
58712025-08-01T16:05:20.062ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 4c7da70d-ede0-4107-abc5-5650a053be38
58722025-08-01T16:05:20.062ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
58732025-08-01T16:05:20.062ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
58742025-08-01T16:05:20.062ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58752025-08-01T16:05:20.062ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58762025-08-01T16:05:20.062ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58772025-08-01T16:05:20.062ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
58782025-08-01T16:05:20.062ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58792025-08-01T16:05:20.062ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
58802025-08-01T16:05:20.062ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
58812025-08-01T16:05:20.062ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58822025-08-01T16:05:20.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58832025-08-01T16:05:20.064ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
58842025-08-01T16:05:20.064ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
58852025-08-01T16:05:20.257ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "caaea2af-9dd5-432c-9de0-482fd50d66cc", "date": "Fri, 01 Aug 2025 16:05:20 GMT"} })
58862025-08-01T16:05:20.257ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch = Switch0
58872025-08-01T16:05:20.257ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
58882025-08-01T16:05:20.257ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "26e88fb5-0bbd-4e5f-a5d4-93a9bd66b130", "content-length": "682", "date": "Fri, 01 Aug 2025 16:05:19 GMT"} })
58892025-08-01T16:05:20.257ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58902025-08-01T16:05:20.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58912025-08-01T16:05:20.261ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58922025-08-01T16:05:20.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58932025-08-01T16:05:20.265ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58942025-08-01T16:05:20.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58952025-08-01T16:05:20.267ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58962025-08-01T16:05:20.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58972025-08-01T16:05:20.274ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 515.679066ms iteration = 16 status = {}
58982025-08-01T16:05:20.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0da7e289-d88a-42e5-a87d-3200e23614ee roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
58992025-08-01T16:05:20.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0da7e289-d88a-42e5-a87d-3200e23614ee resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59002025-08-01T16:05:20.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1685 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0da7e289-d88a-42e5-a87d-3200e23614ee response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59012025-08-01T16:05:21.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d1787697-d8a9-43e3-b7c2-0cacd263af5c roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59022025-08-01T16:05:21.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d1787697-d8a9-43e3-b7c2-0cacd263af5c resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59032025-08-01T16:05:21.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2222 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d1787697-d8a9-43e3-b7c2-0cacd263af5c response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59042025-08-01T16:05:22.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 14401a18-50f2-45c5-a6f7-5edff18480cf roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59052025-08-01T16:05:22.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 14401a18-50f2-45c5-a6f7-5edff18480cf resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59062025-08-01T16:05:22.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1994 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 14401a18-50f2-45c5-a6f7-5edff18480cf response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59072025-08-01T16:05:23.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a7b3a4bb-bf35-40cc-ac37-d147aa23eef5 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59082025-08-01T16:05:23.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a7b3a4bb-bf35-40cc-ac37-d147aa23eef5 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59092025-08-01T16:05:23.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2821 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a7b3a4bb-bf35-40cc-ac37-d147aa23eef5 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59102025-08-01T16:05:24.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 92 reason = Timeout
59112025-08-01T16:05:24.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
59122025-08-01T16:05:24.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
59132025-08-01T16:05:24.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59142025-08-01T16:05:24.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
59152025-08-01T16:05:24.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
59162025-08-01T16:05:24.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
59172025-08-01T16:05:24.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
59182025-08-01T16:05:24.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.574939ms iteration = 92 status = {"chicken_switches_updated":false}
59192025-08-01T16:05:24.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 84651e0e-27a8-45af-aba1-eea9ee5dec9e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59202025-08-01T16:05:24.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 84651e0e-27a8-45af-aba1-eea9ee5dec9e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59212025-08-01T16:05:24.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1691 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 84651e0e-27a8-45af-aba1-eea9ee5dec9e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59222025-08-01T16:05:25.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ba55f975-a6f6-4639-916d-fdb26aa83638 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59232025-08-01T16:05:25.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ba55f975-a6f6-4639-916d-fdb26aa83638 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59242025-08-01T16:05:25.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2246 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ba55f975-a6f6-4639-916d-fdb26aa83638 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59252025-08-01T16:05:26.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1891f0ae-5808-445b-86b8-041d062ba089 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59262025-08-01T16:05:26.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1891f0ae-5808-445b-86b8-041d062ba089 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59272025-08-01T16:05:26.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2095 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1891f0ae-5808-445b-86b8-041d062ba089 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59282025-08-01T16:05:27.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 344a0665-1337-463e-95ec-f6a3b4f0ccdd roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59292025-08-01T16:05:27.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 344a0665-1337-463e-95ec-f6a3b4f0ccdd resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59302025-08-01T16:05:27.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2308 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 344a0665-1337-463e-95ec-f6a3b4f0ccdd response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59312025-08-01T16:05:28.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = deec2866-a10d-4451-be0c-9544f8a26ab5 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59322025-08-01T16:05:28.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = deec2866-a10d-4451-be0c-9544f8a26ab5 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59332025-08-01T16:05:28.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1771 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = deec2866-a10d-4451-be0c-9544f8a26ab5 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59342025-08-01T16:05:29.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
59352025-08-01T16:05:29.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59362025-08-01T16:05:29.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 93 reason = Timeout
59372025-08-01T16:05:29.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
59382025-08-01T16:05:29.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59392025-08-01T16:05:29.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
59402025-08-01T16:05:29.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
59412025-08-01T16:05:29.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59422025-08-01T16:05:29.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59432025-08-01T16:05:29.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59442025-08-01T16:05:29.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59452025-08-01T16:05:29.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59462025-08-01T16:05:29.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59472025-08-01T16:05:29.762ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.721432ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59482025-08-01T16:05:29.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
59492025-08-01T16:05:29.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
59502025-08-01T16:05:29.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
59512025-08-01T16:05:29.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59522025-08-01T16:05:29.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59532025-08-01T16:05:29.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59542025-08-01T16:05:29.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
59552025-08-01T16:05:29.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.752235ms iteration = 93 status = {"chicken_switches_updated":false}
59562025-08-01T16:05:29.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59572025-08-01T16:05:29.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59582025-08-01T16:05:29.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59592025-08-01T16:05:29.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
59602025-08-01T16:05:29.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59612025-08-01T16:05:29.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59622025-08-01T16:05:29.787ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
59632025-08-01T16:05:29.787ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.921516ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
59642025-08-01T16:05:29.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8cf8a68c-1296-4d8a-a3d1-22208db756d8 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59652025-08-01T16:05:29.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8cf8a68c-1296-4d8a-a3d1-22208db756d8 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59662025-08-01T16:05:29.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2262 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8cf8a68c-1296-4d8a-a3d1-22208db756d8 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59672025-08-01T16:05:29.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50110 req_id = cf6a9013-29f5-4669-a8ea-04f2675c1d9f roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
59682025-08-01T16:05:29.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50110 req_id = cf6a9013-29f5-4669-a8ea-04f2675c1d9f resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
59692025-08-01T16:05:29.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2957 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50110 req_id = cf6a9013-29f5-4669-a8ea-04f2675c1d9f response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
59702025-08-01T16:05:29.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50110 req_id = d1688f8f-000c-4fa4-867c-a722dce4a4a8 roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
59712025-08-01T16:05:29.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50110 req_id = d1688f8f-000c-4fa4-867c-a722dce4a4a8 resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
59722025-08-01T16:05:29.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2265 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50110 req_id = d1688f8f-000c-4fa4-867c-a722dce4a4a8 response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
59732025-08-01T16:05:29.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 493 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 7dc73990-0b5d-4a8d-aae0-f72621d2a3a0 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
59742025-08-01T16:05:30.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 90eb0b2a-9492-4f8a-9428-bcc6baf75531 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59752025-08-01T16:05:30.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 90eb0b2a-9492-4f8a-9428-bcc6baf75531 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59762025-08-01T16:05:30.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2167 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 90eb0b2a-9492-4f8a-9428-bcc6baf75531 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59772025-08-01T16:05:31.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0a10c38e-a2dd-4f82-b507-ebb8c901d4bc roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59782025-08-01T16:05:31.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0a10c38e-a2dd-4f82-b507-ebb8c901d4bc resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59792025-08-01T16:05:31.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2475 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0a10c38e-a2dd-4f82-b507-ebb8c901d4bc response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59802025-08-01T16:05:32.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a649669f-d17f-4294-8a39-220b4bfd206a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59812025-08-01T16:05:32.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a649669f-d17f-4294-8a39-220b4bfd206a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59822025-08-01T16:05:32.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2317 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a649669f-d17f-4294-8a39-220b4bfd206a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59832025-08-01T16:05:33.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b0b9389a-4941-4f51-8f0d-d8e0db0c529a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59842025-08-01T16:05:33.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b0b9389a-4941-4f51-8f0d-d8e0db0c529a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59852025-08-01T16:05:33.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1851 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b0b9389a-4941-4f51-8f0d-d8e0db0c529a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59862025-08-01T16:05:34.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 94 reason = Timeout
59872025-08-01T16:05:34.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
59882025-08-01T16:05:34.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
59892025-08-01T16:05:34.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59902025-08-01T16:05:34.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
59912025-08-01T16:05:34.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
59922025-08-01T16:05:34.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
59932025-08-01T16:05:34.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
59942025-08-01T16:05:34.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.978521ms iteration = 94 status = {"chicken_switches_updated":false}
59952025-08-01T16:05:34.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e5c01b0b-0dd4-4a4e-9452-f76b73856d9f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59962025-08-01T16:05:34.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e5c01b0b-0dd4-4a4e-9452-f76b73856d9f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59972025-08-01T16:05:34.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2121 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e5c01b0b-0dd4-4a4e-9452-f76b73856d9f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59982025-08-01T16:05:35.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f470f3a5-802c-42ef-9e64-56a340e524c6 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
59992025-08-01T16:05:35.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f470f3a5-802c-42ef-9e64-56a340e524c6 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60002025-08-01T16:05:35.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2426 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f470f3a5-802c-42ef-9e64-56a340e524c6 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60012025-08-01T16:05:36.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9517c90d-28cc-4f62-8d0f-382033a17d71 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60022025-08-01T16:05:36.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9517c90d-28cc-4f62-8d0f-382033a17d71 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60032025-08-01T16:05:36.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2115 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9517c90d-28cc-4f62-8d0f-382033a17d71 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60042025-08-01T16:05:38.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c1fb9772-14c7-49c8-b22d-0e6dc2e923dd roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60052025-08-01T16:05:38.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c1fb9772-14c7-49c8-b22d-0e6dc2e923dd resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60062025-08-01T16:05:38.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2232 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c1fb9772-14c7-49c8-b22d-0e6dc2e923dd response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60072025-08-01T16:05:39.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ae3bacfd-64ec-4c75-972e-8f6d62b4efe1 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60082025-08-01T16:05:39.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ae3bacfd-64ec-4c75-972e-8f6d62b4efe1 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60092025-08-01T16:05:39.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2383 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ae3bacfd-64ec-4c75-972e-8f6d62b4efe1 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60102025-08-01T16:05:39.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
60112025-08-01T16:05:39.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60122025-08-01T16:05:39.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 95 reason = Timeout
60132025-08-01T16:05:39.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
60142025-08-01T16:05:39.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60152025-08-01T16:05:39.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
60162025-08-01T16:05:39.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
60172025-08-01T16:05:39.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60182025-08-01T16:05:39.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60192025-08-01T16:05:39.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60202025-08-01T16:05:39.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60212025-08-01T16:05:39.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60222025-08-01T16:05:39.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60232025-08-01T16:05:39.764ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.838007ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60242025-08-01T16:05:39.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
60252025-08-01T16:05:39.766ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
60262025-08-01T16:05:39.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
60272025-08-01T16:05:39.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60282025-08-01T16:05:39.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60292025-08-01T16:05:39.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60302025-08-01T16:05:39.767ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
60312025-08-01T16:05:39.767ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.2612ms iteration = 95 status = {"chicken_switches_updated":false}
60322025-08-01T16:05:39.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60332025-08-01T16:05:39.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60342025-08-01T16:05:39.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60352025-08-01T16:05:39.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
60362025-08-01T16:05:39.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60372025-08-01T16:05:39.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60382025-08-01T16:05:39.794ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
60392025-08-01T16:05:39.794ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 34.547028ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
60402025-08-01T16:05:39.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 704 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 5d792ad0-ddce-4228-945a-499b3dbc12f7 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
60412025-08-01T16:05:40.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6db29029-3d22-48b9-93b5-a24f37bd7ce5 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60422025-08-01T16:05:40.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6db29029-3d22-48b9-93b5-a24f37bd7ce5 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60432025-08-01T16:05:40.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2214 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6db29029-3d22-48b9-93b5-a24f37bd7ce5 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60442025-08-01T16:05:41.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1ab8a6db-a9e2-4d1e-81d6-fb8bf99458ab roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60452025-08-01T16:05:41.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1ab8a6db-a9e2-4d1e-81d6-fb8bf99458ab resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60462025-08-01T16:05:41.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2372 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1ab8a6db-a9e2-4d1e-81d6-fb8bf99458ab response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60472025-08-01T16:05:42.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e44b6e9b-fdfb-4fe7-ab1c-8be5d77d8b7d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60482025-08-01T16:05:42.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e44b6e9b-fdfb-4fe7-ab1c-8be5d77d8b7d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60492025-08-01T16:05:42.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2364 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e44b6e9b-fdfb-4fe7-ab1c-8be5d77d8b7d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60502025-08-01T16:05:43.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = adae57bb-469e-4057-819c-732d86c03d2e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60512025-08-01T16:05:43.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = adae57bb-469e-4057-819c-732d86c03d2e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60522025-08-01T16:05:43.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 5316 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = adae57bb-469e-4057-819c-732d86c03d2e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60532025-08-01T16:05:44.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f66c34f6-151d-4655-87da-f64a0b24b26b roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60542025-08-01T16:05:44.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f66c34f6-151d-4655-87da-f64a0b24b26b resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60552025-08-01T16:05:44.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1821 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f66c34f6-151d-4655-87da-f64a0b24b26b response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60562025-08-01T16:05:44.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 96 reason = Timeout
60572025-08-01T16:05:44.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
60582025-08-01T16:05:44.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
60592025-08-01T16:05:44.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60602025-08-01T16:05:44.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
60612025-08-01T16:05:44.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
60622025-08-01T16:05:44.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
60632025-08-01T16:05:44.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
60642025-08-01T16:05:44.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.059964ms iteration = 96 status = {"chicken_switches_updated":false}
60652025-08-01T16:05:45.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = aad831b6-9d71-4508-b77f-8fcb2d2bdfee roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60662025-08-01T16:05:45.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = aad831b6-9d71-4508-b77f-8fcb2d2bdfee resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60672025-08-01T16:05:45.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2048 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = aad831b6-9d71-4508-b77f-8fcb2d2bdfee response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60682025-08-01T16:05:46.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 013b33d1-a82e-4371-be67-505e56b56761 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60692025-08-01T16:05:46.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 013b33d1-a82e-4371-be67-505e56b56761 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60702025-08-01T16:05:46.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2463 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 013b33d1-a82e-4371-be67-505e56b56761 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60712025-08-01T16:05:47.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5088eb0c-2dfc-430d-91ba-fb388ba860ce roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60722025-08-01T16:05:47.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5088eb0c-2dfc-430d-91ba-fb388ba860ce resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60732025-08-01T16:05:47.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2340 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5088eb0c-2dfc-430d-91ba-fb388ba860ce response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60742025-08-01T16:05:48.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d18f6319-8c12-414c-8bc1-fac00201baa1 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60752025-08-01T16:05:48.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d18f6319-8c12-414c-8bc1-fac00201baa1 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60762025-08-01T16:05:48.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2592 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d18f6319-8c12-414c-8bc1-fac00201baa1 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60772025-08-01T16:05:49.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f20ce638-f2af-4f24-aeca-26ef24155529 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60782025-08-01T16:05:49.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f20ce638-f2af-4f24-aeca-26ef24155529 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60792025-08-01T16:05:49.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2149 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f20ce638-f2af-4f24-aeca-26ef24155529 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
60802025-08-01T16:05:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
60812025-08-01T16:05:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
60822025-08-01T16:05:49.688ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
60832025-08-01T16:05:49.688ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
60842025-08-01T16:05:49.688ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-01 15:55:49.688019244 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
60852025-08-01T16:05:49.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60862025-08-01T16:05:49.688ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
60872025-08-01T16:05:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
60882025-08-01T16:05:49.688ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
60892025-08-01T16:05:49.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60902025-08-01T16:05:49.688ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
60912025-08-01T16:05:49.688ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60922025-08-01T16:05:49.688ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
60932025-08-01T16:05:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
60942025-08-01T16:05:49.688ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
60952025-08-01T16:05:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
60962025-08-01T16:05:49.688ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
60972025-08-01T16:05:49.688ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
60982025-08-01T16:05:49.688ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60992025-08-01T16:05:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
61002025-08-01T16:05:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
61012025-08-01T16:05:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
61022025-08-01T16:05:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61032025-08-01T16:05:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61042025-08-01T16:05:49.688ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cb706a84-a33b-442f-aac2-3a6eb5f3b330.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d688a68d-d771-4ac5-8e66-9efa94dbbea8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d688a68d-d771-4ac5-8e66-9efa94dbbea8.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 44045, tv_nsec: 704929354 } })
61052025-08-01T16:05:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
61062025-08-01T16:05:49.688ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50fe31de-3241-42df-a386-de37ce323a34.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("58598327-8751-423c-a5ac-c610829651e2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 44045, tv_nsec: 704967745 } })
61072025-08-01T16:05:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61082025-08-01T16:05:49.689ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
61092025-08-01T16:05:49.689ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.037472ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
61102025-08-01T16:05:49.689ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
61112025-08-01T16:05:49.689ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 908.867\u{b5}s iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
61122025-08-01T16:05:49.690ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61132025-08-01T16:05:49.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61142025-08-01T16:05:49.690ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61152025-08-01T16:05:49.690ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-01 15:55:49.688019244 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
61162025-08-01T16:05:49.690ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.904008ms iteration = 9 status = {"expiration":"2025-08-01T15:55:49.688019244Z","pruned":[]}
61172025-08-01T16:05:49.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61182025-08-01T16:05:49.691ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44045, tv_nsec: 707600965 } })
61192025-08-01T16:05:49.691ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
61202025-08-01T16:05:49.692ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.384263ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
61212025-08-01T16:05:49.692ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61222025-08-01T16:05:49.693ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61232025-08-01T16:05:49.693ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44045, tv_nsec: 709595426 } })
61242025-08-01T16:05:49.693ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
61252025-08-01T16:05:49.693ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61262025-08-01T16:05:49.697ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
61272025-08-01T16:05:49.697ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61282025-08-01T16:05:49.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61292025-08-01T16:05:49.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61302025-08-01T16:05:49.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
61312025-08-01T16:05:49.699ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61322025-08-01T16:05:49.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61332025-08-01T16:05:49.701ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61342025-08-01T16:05:49.705ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
61352025-08-01T16:05:49.705ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61362025-08-01T16:05:49.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61372025-08-01T16:05:49.707ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
61382025-08-01T16:05:49.707ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1
61392025-08-01T16:05:49.707ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.591\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1"}
61402025-08-01T16:05:49.707ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61412025-08-01T16:05:49.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61422025-08-01T16:05:49.709ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 12 reason = Timeout
61432025-08-01T16:05:49.709ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
61442025-08-01T16:05:49.709ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 12.77\u{b5}s iteration = 12 status = "Disabled"
61452025-08-01T16:05:49.709ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61462025-08-01T16:05:49.710ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
61472025-08-01T16:05:49.710ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
61482025-08-01T16:05:49.710ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 9 reason = Timeout
61492025-08-01T16:05:49.710ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
61502025-08-01T16:05:49.710ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
61512025-08-01T16:05:49.710ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
61522025-08-01T16:05:49.710ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
61532025-08-01T16:05:49.710ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
61542025-08-01T16:05:49.710ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
61552025-08-01T16:05:49.710ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 9 reason = Timeout
61562025-08-01T16:05:49.710ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
61572025-08-01T16:05:49.710ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
61582025-08-01T16:05:49.710ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
61592025-08-01T16:05:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
61602025-08-01T16:05:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
61612025-08-01T16:05:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
61622025-08-01T16:05:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
61632025-08-01T16:05:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
61642025-08-01T16:05:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
61652025-08-01T16:05:49.711ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
61662025-08-01T16:05:49.711ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61672025-08-01T16:05:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61682025-08-01T16:05:49.712ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61692025-08-01T16:05:49.714ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.96629ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
61702025-08-01T16:05:49.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
61712025-08-01T16:05:49.714ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
61722025-08-01T16:05:49.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
61732025-08-01T16:05:49.714ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
61742025-08-01T16:05:49.714ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 4.214948ms iteration = 9 status = {"by_rx":{},"error":null}
61752025-08-01T16:05:49.717ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
61762025-08-01T16:05:49.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
61772025-08-01T16:05:49.720ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 10.167108ms iteration = 9 status = {"dispatched":[],"errors":[],"glob_version":"173.0.0","globs_reprocessed":{},"no_receivers":[]}
61782025-08-01T16:05:49.754ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
61792025-08-01T16:05:49.754ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
61802025-08-01T16:05:49.754ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
61812025-08-01T16:05:49.754ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61822025-08-01T16:05:49.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61832025-08-01T16:05:49.756ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61842025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
61852025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 17 reason = Timeout
61862025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
61872025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
61882025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 20.271\u{b5}s iteration = 17 status = {"disabled":true,"errors":[],"sps":[]}
61892025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
61902025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
61912025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
61922025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61932025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61942025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61952025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61962025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 17 reason = Timeout
61972025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
61982025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
61992025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
62002025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62012025-08-01T16:05:49.758ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
62022025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
62032025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
62042025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62052025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62062025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
62072025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
62082025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
62092025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
62102025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62112025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
62122025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
62132025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62142025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
62152025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62162025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
62172025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62182025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
62192025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62202025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 97 reason = Timeout
62212025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
62222025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62232025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62242025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62252025-08-01T16:05:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62262025-08-01T16:05:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62272025-08-01T16:05:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62282025-08-01T16:05:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
62292025-08-01T16:05:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62302025-08-01T16:05:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62312025-08-01T16:05:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62322025-08-01T16:05:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62332025-08-01T16:05:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62342025-08-01T16:05:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62352025-08-01T16:05:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
62362025-08-01T16:05:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
62372025-08-01T16:05:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
62382025-08-01T16:05:49.759ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 17 reason = Timeout
62392025-08-01T16:05:49.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
62402025-08-01T16:05:49.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62412025-08-01T16:05:49.759ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
62422025-08-01T16:05:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62432025-08-01T16:05:49.760ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62442025-08-01T16:05:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
62452025-08-01T16:05:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62462025-08-01T16:05:49.760ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62472025-08-01T16:05:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62482025-08-01T16:05:49.761ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62492025-08-01T16:05:49.762ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62502025-08-01T16:05:49.764ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62512025-08-01T16:05:49.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
62522025-08-01T16:05:49.765ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62532025-08-01T16:05:49.765ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62542025-08-01T16:05:49.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62552025-08-01T16:05:49.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62562025-08-01T16:05:49.765ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62572025-08-01T16:05:49.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62582025-08-01T16:05:49.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62592025-08-01T16:05:49.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
62602025-08-01T16:05:49.765ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62612025-08-01T16:05:49.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62622025-08-01T16:05:49.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62632025-08-01T16:05:49.765ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62642025-08-01T16:05:49.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62652025-08-01T16:05:49.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62662025-08-01T16:05:49.766ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62672025-08-01T16:05:49.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62682025-08-01T16:05:49.766ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62692025-08-01T16:05:49.767ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62702025-08-01T16:05:49.767ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.964261ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
62712025-08-01T16:05:49.768ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.193559ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
62722025-08-01T16:05:49.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62732025-08-01T16:05:49.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62742025-08-01T16:05:49.769ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62752025-08-01T16:05:49.769ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62762025-08-01T16:05:49.769ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
62772025-08-01T16:05:49.769ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
62782025-08-01T16:05:49.769ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 59.007389ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
62792025-08-01T16:05:49.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62802025-08-01T16:05:49.771ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.038476ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62812025-08-01T16:05:49.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
62822025-08-01T16:05:49.771ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
62832025-08-01T16:05:49.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
62842025-08-01T16:05:49.772ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62852025-08-01T16:05:49.772ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62862025-08-01T16:05:49.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62872025-08-01T16:05:49.772ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44045, tv_nsec: 789233860 } })
62882025-08-01T16:05:49.773ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
62892025-08-01T16:05:49.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
62902025-08-01T16:05:49.774ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
62912025-08-01T16:05:49.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
62922025-08-01T16:05:49.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62932025-08-01T16:05:49.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62942025-08-01T16:05:49.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62952025-08-01T16:05:49.774ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
62962025-08-01T16:05:49.774ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 16.366716ms iteration = 97 status = {"chicken_switches_updated":false}
62972025-08-01T16:05:49.774ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62982025-08-01T16:05:49.775ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62992025-08-01T16:05:49.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63002025-08-01T16:05:49.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63012025-08-01T16:05:49.776ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
63022025-08-01T16:05:49.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63032025-08-01T16:05:49.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
63042025-08-01T16:05:49.777ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63052025-08-01T16:05:49.777ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63062025-08-01T16:05:49.777ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63072025-08-01T16:05:49.778ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63082025-08-01T16:05:49.778ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63092025-08-01T16:05:49.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63102025-08-01T16:05:49.779ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
63112025-08-01T16:05:49.779ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 21.390268ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
63122025-08-01T16:05:49.780ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-01T15:57:44.766264Z, time_modified: 2025-08-01T15:57:44.766264Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: eec17da7-eb17-4917-8728-908698b69bbe, db_silo: Silo { identity: SiloIdentity { id: eec17da7-eb17-4917-8728-908698b69bbe, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-01T15:58:34.653875Z, time_modified: 2025-08-01T15:58:34.653875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: eec17da7-eb17-4917-8728-908698b69bbe, db_silo: Silo { identity: SiloIdentity { id: eec17da7-eb17-4917-8728-908698b69bbe, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-01T15:58:34.653875Z, time_modified: 2025-08-01T15:58:34.653875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575" }] }) }
63132025-08-01T16:05:49.780ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 92.482924ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"eec17da7-eb17-4917-8728-908698b69bbe","tls_certs":["b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575"]}},"default_endpoint":{"silo_id":"eec17da7-eb17-4917-8728-908698b69bbe","tls_certs":["b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
63142025-08-01T16:05:49.781ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
63152025-08-01T16:05:49.781ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
63162025-08-01T16:05:49.781ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 70.911281ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
63172025-08-01T16:05:49.781ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
63182025-08-01T16:05:49.781ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63192025-08-01T16:05:49.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63202025-08-01T16:05:49.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
63212025-08-01T16:05:49.782ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
63222025-08-01T16:05:49.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
63232025-08-01T16:05:49.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63242025-08-01T16:05:49.782ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63252025-08-01T16:05:49.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63262025-08-01T16:05:49.784ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:391
63272025-08-01T16:05:49.784ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 24.426041ms iteration = 17 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
63282025-08-01T16:05:49.788ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 30.209766ms iteration = 19 status = {"physical_disks_added":0}
63292025-08-01T16:05:49.801ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
63302025-08-01T16:05:49.812ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
63312025-08-01T16:05:49.812ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.510742ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
63322025-08-01T16:05:49.813ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63332025-08-01T16:05:49.813ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 55.570875ms iteration = 17 status = {"errors":[],"requests_created_ok":[]}
63342025-08-01T16:05:49.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63352025-08-01T16:05:49.816ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63362025-08-01T16:05:49.816ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
63372025-08-01T16:05:49.816ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63382025-08-01T16:05:49.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63392025-08-01T16:05:49.824ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
63402025-08-01T16:05:49.824ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6482e44c-c860-4033-b945-5707d343a59d dns_zone_name = oxide.test found_so_far = 0 version = 2
63412025-08-01T16:05:49.824ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63422025-08-01T16:05:49.824ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
63432025-08-01T16:05:49.824ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63442025-08-01T16:05:49.825ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b69dd97c-dc5e-4736-858a-7b4c5d65d313", "content-length": "26", "date": "Fri, 01 Aug 2025 16:05:49 GMT"} })
63452025-08-01T16:05:49.825ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63462025-08-01T16:05:49.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63472025-08-01T16:05:49.826ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63482025-08-01T16:05:49.827ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63492025-08-01T16:05:49.827ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63502025-08-01T16:05:49.829ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 71.22914ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63512025-08-01T16:05:49.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
63522025-08-01T16:05:49.830ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63532025-08-01T16:05:49.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63542025-08-01T16:05:49.832ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63552025-08-01T16:05:49.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63562025-08-01T16:05:49.832ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
63572025-08-01T16:05:49.832ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 02fcb774-aa43-4052-9996-b85e2d1358b5 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
63582025-08-01T16:05:49.832ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63592025-08-01T16:05:49.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63602025-08-01T16:05:49.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63612025-08-01T16:05:49.834ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63622025-08-01T16:05:49.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63632025-08-01T16:05:49.835ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63642025-08-01T16:05:49.836ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6482e44c-c860-4033-b945-5707d343a59d dns_zone_name = oxide.test found_so_far = 4 version = 2
63652025-08-01T16:05:49.836ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
63662025-08-01T16:05:49.836ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-01 15:58:34.713515 UTC dns_group = external generation = 2
63672025-08-01T16:05:49.836ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 148.352598ms iteration = 9 status = {"generation":2}
63682025-08-01T16:05:49.836ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 78.414247ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63692025-08-01T16:05:49.839ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63702025-08-01T16:05:49.839ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63712025-08-01T16:05:49.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63722025-08-01T16:05:49.847ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 02fcb774-aa43-4052-9996-b85e2d1358b5 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
63732025-08-01T16:05:49.847ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
63742025-08-01T16:05:49.847ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-01 15:58:34.032744 UTC dns_group = internal generation = 1
63752025-08-01T16:05:49.847ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 159.407414ms iteration = 9 status = {"generation":1}
63762025-08-01T16:05:49.868ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
63772025-08-01T16:05:49.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
63782025-08-01T16:05:49.870ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 111.762899ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
63792025-08-01T16:05:49.871ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
63802025-08-01T16:05:49.871ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 161.340882ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
63812025-08-01T16:05:49.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63822025-08-01T16:05:49.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63832025-08-01T16:05:49.887ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63842025-08-01T16:05:49.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63852025-08-01T16:05:49.889ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63862025-08-01T16:05:49.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
63872025-08-01T16:05:49.892ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63882025-08-01T16:05:49.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63892025-08-01T16:05:49.893ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 135.390475ms iteration = 17 status = 0
63902025-08-01T16:05:49.894ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63912025-08-01T16:05:49.894ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
63922025-08-01T16:05:49.894ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63932025-08-01T16:05:49.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63942025-08-01T16:05:49.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 572 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = e9b59e31-4ff6-405a-98a8-7fc52b9ea32f response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
63952025-08-01T16:05:49.927ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
63962025-08-01T16:05:49.927ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63972025-08-01T16:05:49.927ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ec7e706-d833-409a-954d-0fe7dd29974e", "content-length": "26", "date": "Fri, 01 Aug 2025 16:05:49 GMT"} })
63982025-08-01T16:05:49.927ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63992025-08-01T16:05:49.929ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64002025-08-01T16:05:49.931ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64012025-08-01T16:05:49.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64022025-08-01T16:05:49.942ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64032025-08-01T16:05:49.942ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
64042025-08-01T16:05:49.942ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 184.061501ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
64052025-08-01T16:05:49.947ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 zone_address = fd00:1122:3344:101::2
64062025-08-01T16:05:49.947ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64072025-08-01T16:05:49.948ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "640e3210-1488-4f64-b377-9a96c2779b14", "content-length": "26", "date": "Fri, 01 Aug 2025 16:05:49 GMT"} })
64082025-08-01T16:05:49.948ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64092025-08-01T16:05:49.949ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
64102025-08-01T16:05:49.949ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
64112025-08-01T16:05:49.949ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "98cf5743-8b10-40a6-8eb5-aa33a0ba30c9", "date": "Fri, 01 Aug 2025 16:05:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
64122025-08-01T16:05:49.949ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
64132025-08-01T16:05:49.951ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "428615bb-b618-4b80-bab2-fc73a6cfef3a", "date": "Fri, 01 Aug 2025 16:05:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
64142025-08-01T16:05:49.951ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
64152025-08-01T16:05:49.953ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
64162025-08-01T16:05:49.953ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 265.055207ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
64172025-08-01T16:05:49.972ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64182025-08-01T16:05:49.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64192025-08-01T16:05:49.975ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 287.292201ms iteration = 17 status = null
64202025-08-01T16:05:49.977ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64212025-08-01T16:05:49.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64222025-08-01T16:05:49.979ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64232025-08-01T16:05:49.980ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
64242025-08-01T16:05:49.982ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64252025-08-01T16:05:49.982ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64262025-08-01T16:05:49.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64272025-08-01T16:05:49.983ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64282025-08-01T16:05:49.985ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64292025-08-01T16:05:49.985ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64302025-08-01T16:05:49.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64312025-08-01T16:05:50.085ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 397.146742ms iteration = 17 status = {}
64322025-08-01T16:05:50.097ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
64332025-08-01T16:05:50.097ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64342025-08-01T16:05:50.097ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "078056c0-77d0-4103-a7d1-098f759d7814", "content-length": "372", "date": "Fri, 01 Aug 2025 16:05:49 GMT"} })
64352025-08-01T16:05:50.097ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64362025-08-01T16:05:50.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64372025-08-01T16:05:50.148ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
64382025-08-01T16:05:50.149ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d6b2219-bee8-472d-914d-abebc2524fc9", "content-length": "691", "date": "Fri, 01 Aug 2025 16:05:49 GMT"} })
64392025-08-01T16:05:50.149ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
64402025-08-01T16:05:50.149ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
64412025-08-01T16:05:50.149ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
64422025-08-01T16:05:50.150ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
64432025-08-01T16:05:50.150ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
64442025-08-01T16:05:50.150ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "551dcb4c-7185-48cf-924a-d34db3de87a9", "date": "Fri, 01 Aug 2025 16:05:49 GMT"} })
64452025-08-01T16:05:50.150ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64462025-08-01T16:05:50.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64472025-08-01T16:05:50.151ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 392.889423ms iteration = 17 status = {}
64482025-08-01T16:05:50.153ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64492025-08-01T16:05:50.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64502025-08-01T16:05:50.156ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64512025-08-01T16:05:50.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64522025-08-01T16:05:50.160ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
64532025-08-01T16:05:50.160ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64542025-08-01T16:05:50.160ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7c713745-3bc2-4860-bd59-67cb516b9b0b", "date": "Fri, 01 Aug 2025 16:05:49 GMT"} })
64552025-08-01T16:05:50.162ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 403.885776ms iteration = 17 status = {}
64562025-08-01T16:05:50.200ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
64572025-08-01T16:05:50.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 68abce11-f4e0-4eaf-a0c1-e2d6dde92d89 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
64582025-08-01T16:05:50.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 68abce11-f4e0-4eaf-a0c1-e2d6dde92d89 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
64592025-08-01T16:05:50.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1624 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 68abce11-f4e0-4eaf-a0c1-e2d6dde92d89 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
64602025-08-01T16:05:50.333ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
64612025-08-01T16:05:50.334ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e46107c4-e94b-4a8c-ac27-1343b2b4a173", "date": "Fri, 01 Aug 2025 16:05:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
64622025-08-01T16:05:50.334ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
64632025-08-01T16:05:50.336ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "dd4f05f6-ed4d-4cb1-8a64-3e09452e3972", "date": "Fri, 01 Aug 2025 16:05:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
64642025-08-01T16:05:50.336ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
64652025-08-01T16:05:50.338ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a6624ce8-6a07-46cb-970c-9b6f53d5aa77", "date": "Fri, 01 Aug 2025 16:05:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
64662025-08-01T16:05:50.338ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
64672025-08-01T16:05:50.340ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
64682025-08-01T16:05:50.340ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 652.464983ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
64692025-08-01T16:05:50.354ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64702025-08-01T16:05:50.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64712025-08-01T16:05:50.356ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 3f21d9d5-3adf-463a-a05d-bc2e2e5d64ca, rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(4c7da70d-ede0-4107-abc5-5650a053be38) } rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
64722025-08-01T16:05:50.356ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64732025-08-01T16:05:50.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64742025-08-01T16:05:50.366ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
64752025-08-01T16:05:50.366ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 4c7da70d-ede0-4107-abc5-5650a053be38
64762025-08-01T16:05:50.366ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
64772025-08-01T16:05:50.367ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
64782025-08-01T16:05:50.367ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64792025-08-01T16:05:50.367ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64802025-08-01T16:05:50.367ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64812025-08-01T16:05:50.367ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64822025-08-01T16:05:50.367ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64832025-08-01T16:05:50.367ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64842025-08-01T16:05:50.367ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
64852025-08-01T16:05:50.367ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64862025-08-01T16:05:50.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64872025-08-01T16:05:50.369ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
64882025-08-01T16:05:50.369ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
64892025-08-01T16:05:50.535ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "35e3a911-21e6-4e56-897f-de4b7de9761f", "date": "Fri, 01 Aug 2025 16:05:49 GMT"} })
64902025-08-01T16:05:50.535ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch = Switch0
64912025-08-01T16:05:50.535ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
64922025-08-01T16:05:50.535ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb31812e-f7ff-4510-85e9-011acbb86d91", "content-length": "682", "date": "Fri, 01 Aug 2025 16:05:49 GMT"} })
64932025-08-01T16:05:50.535ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64942025-08-01T16:05:50.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64952025-08-01T16:05:50.539ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64962025-08-01T16:05:50.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64972025-08-01T16:05:50.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64982025-08-01T16:05:50.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64992025-08-01T16:05:50.544ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65002025-08-01T16:05:50.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65012025-08-01T16:05:50.550ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 792.418106ms iteration = 17 status = {}
65022025-08-01T16:05:51.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d242eb52-4f31-4e5a-a4b0-2f2cd1e6f333 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65032025-08-01T16:05:51.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d242eb52-4f31-4e5a-a4b0-2f2cd1e6f333 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65042025-08-01T16:05:51.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2640 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d242eb52-4f31-4e5a-a4b0-2f2cd1e6f333 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65052025-08-01T16:05:52.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b3612667-3f1d-4e42-8c0f-b9f59757d5cd roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65062025-08-01T16:05:52.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b3612667-3f1d-4e42-8c0f-b9f59757d5cd resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65072025-08-01T16:05:52.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2361 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b3612667-3f1d-4e42-8c0f-b9f59757d5cd response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65082025-08-01T16:05:53.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cc8bd547-64b5-4acc-83d4-7c2bd3744321 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65092025-08-01T16:05:53.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cc8bd547-64b5-4acc-83d4-7c2bd3744321 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65102025-08-01T16:05:53.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1956 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cc8bd547-64b5-4acc-83d4-7c2bd3744321 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65112025-08-01T16:05:54.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 55ce00f0-8284-47af-a81c-6dd5b1b7fe82 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65122025-08-01T16:05:54.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 55ce00f0-8284-47af-a81c-6dd5b1b7fe82 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65132025-08-01T16:05:54.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2243 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 55ce00f0-8284-47af-a81c-6dd5b1b7fe82 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65142025-08-01T16:05:54.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 98 reason = Timeout
65152025-08-01T16:05:54.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
65162025-08-01T16:05:54.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
65172025-08-01T16:05:54.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65182025-08-01T16:05:54.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
65192025-08-01T16:05:54.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
65202025-08-01T16:05:54.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
65212025-08-01T16:05:54.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
65222025-08-01T16:05:54.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.866389ms iteration = 98 status = {"chicken_switches_updated":false}
65232025-08-01T16:05:55.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8b5097c1-b251-4481-8408-18325cc732b9 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65242025-08-01T16:05:55.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8b5097c1-b251-4481-8408-18325cc732b9 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65252025-08-01T16:05:55.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2305 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8b5097c1-b251-4481-8408-18325cc732b9 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65262025-08-01T16:05:56.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4999ce34-2dc8-430b-988e-ffc0ca126bc7 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65272025-08-01T16:05:56.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4999ce34-2dc8-430b-988e-ffc0ca126bc7 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65282025-08-01T16:05:56.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2014 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4999ce34-2dc8-430b-988e-ffc0ca126bc7 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65292025-08-01T16:05:57.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a29c455c-84a6-44bb-8b33-2579f37f8419 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65302025-08-01T16:05:57.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a29c455c-84a6-44bb-8b33-2579f37f8419 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65312025-08-01T16:05:57.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2320 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a29c455c-84a6-44bb-8b33-2579f37f8419 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65322025-08-01T16:05:58.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 242b9559-c565-4723-a59e-1394921dc52e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65332025-08-01T16:05:58.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 242b9559-c565-4723-a59e-1394921dc52e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65342025-08-01T16:05:58.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1711 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 242b9559-c565-4723-a59e-1394921dc52e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65352025-08-01T16:05:59.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3ddfba7b-94f5-4884-93e5-df6418b73b42 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65362025-08-01T16:05:59.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3ddfba7b-94f5-4884-93e5-df6418b73b42 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65372025-08-01T16:05:59.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2322 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3ddfba7b-94f5-4884-93e5-df6418b73b42 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65382025-08-01T16:05:59.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
65392025-08-01T16:05:59.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 99 reason = Timeout
65402025-08-01T16:05:59.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65412025-08-01T16:05:59.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
65422025-08-01T16:05:59.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
65432025-08-01T16:05:59.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65442025-08-01T16:05:59.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
65452025-08-01T16:05:59.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65462025-08-01T16:05:59.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65472025-08-01T16:05:59.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65482025-08-01T16:05:59.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65492025-08-01T16:05:59.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65502025-08-01T16:05:59.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65512025-08-01T16:05:59.762ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.754564ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65522025-08-01T16:05:59.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
65532025-08-01T16:05:59.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
65542025-08-01T16:05:59.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
65552025-08-01T16:05:59.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65562025-08-01T16:05:59.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65572025-08-01T16:05:59.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65582025-08-01T16:05:59.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
65592025-08-01T16:05:59.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.444276ms iteration = 99 status = {"chicken_switches_updated":false}
65602025-08-01T16:05:59.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65612025-08-01T16:05:59.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65622025-08-01T16:05:59.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65632025-08-01T16:05:59.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
65642025-08-01T16:05:59.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65652025-08-01T16:05:59.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65662025-08-01T16:05:59.786ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
65672025-08-01T16:05:59.786ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.194385ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
65682025-08-01T16:05:59.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 557 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = dae6f61b-04cd-4731-ab2f-7e76388d04a4 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
65692025-08-01T16:06:00.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 82fe88a3-dae6-40e8-abee-d28de568003e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65702025-08-01T16:06:00.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 82fe88a3-dae6-40e8-abee-d28de568003e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65712025-08-01T16:06:00.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2324 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 82fe88a3-dae6-40e8-abee-d28de568003e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65722025-08-01T16:06:01.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 79006440-f55c-4982-8d19-1969ca67108f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65732025-08-01T16:06:01.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 79006440-f55c-4982-8d19-1969ca67108f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65742025-08-01T16:06:01.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2432 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 79006440-f55c-4982-8d19-1969ca67108f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65752025-08-01T16:06:02.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7de9e956-124a-4a0b-8c4a-98118a267857 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65762025-08-01T16:06:02.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7de9e956-124a-4a0b-8c4a-98118a267857 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65772025-08-01T16:06:02.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2231 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7de9e956-124a-4a0b-8c4a-98118a267857 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65782025-08-01T16:06:03.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7a8037e9-fae3-4246-a172-a28383566ce6 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65792025-08-01T16:06:03.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7a8037e9-fae3-4246-a172-a28383566ce6 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65802025-08-01T16:06:03.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1605 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7a8037e9-fae3-4246-a172-a28383566ce6 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65812025-08-01T16:06:04.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 50728162-3d6d-4a4a-a889-b5c78860ac46 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65822025-08-01T16:06:04.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 50728162-3d6d-4a4a-a889-b5c78860ac46 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65832025-08-01T16:06:04.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2511 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 50728162-3d6d-4a4a-a889-b5c78860ac46 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65842025-08-01T16:06:04.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 100 reason = Timeout
65852025-08-01T16:06:04.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
65862025-08-01T16:06:04.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
65872025-08-01T16:06:04.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65882025-08-01T16:06:04.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
65892025-08-01T16:06:04.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
65902025-08-01T16:06:04.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
65912025-08-01T16:06:04.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
65922025-08-01T16:06:04.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.088645ms iteration = 100 status = {"chicken_switches_updated":false}
65932025-08-01T16:06:05.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1a3a236b-6b1a-424d-a597-30ac34c2c7c5 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65942025-08-01T16:06:05.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1a3a236b-6b1a-424d-a597-30ac34c2c7c5 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65952025-08-01T16:06:05.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2514 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1a3a236b-6b1a-424d-a597-30ac34c2c7c5 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65962025-08-01T16:06:06.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3c3d37b8-2e40-473f-9bb3-f34b553b683c roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65972025-08-01T16:06:06.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3c3d37b8-2e40-473f-9bb3-f34b553b683c resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65982025-08-01T16:06:06.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1974 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3c3d37b8-2e40-473f-9bb3-f34b553b683c response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
65992025-08-01T16:06:07.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d707cf03-9b3b-4ffa-91ca-f24ba87e3974 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66002025-08-01T16:06:07.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d707cf03-9b3b-4ffa-91ca-f24ba87e3974 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66012025-08-01T16:06:07.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2216 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d707cf03-9b3b-4ffa-91ca-f24ba87e3974 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66022025-08-01T16:06:08.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f97454e9-f085-4c58-a9ac-2512972d0c81 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66032025-08-01T16:06:08.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f97454e9-f085-4c58-a9ac-2512972d0c81 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66042025-08-01T16:06:08.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2112 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f97454e9-f085-4c58-a9ac-2512972d0c81 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66052025-08-01T16:06:09.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0fe37e3d-1954-4d26-9dc4-1d226788d66a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66062025-08-01T16:06:09.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0fe37e3d-1954-4d26-9dc4-1d226788d66a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66072025-08-01T16:06:09.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2931 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0fe37e3d-1954-4d26-9dc4-1d226788d66a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66082025-08-01T16:06:09.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
66092025-08-01T16:06:09.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 101 reason = Timeout
66102025-08-01T16:06:09.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66112025-08-01T16:06:09.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
66122025-08-01T16:06:09.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66132025-08-01T16:06:09.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
66142025-08-01T16:06:09.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
66152025-08-01T16:06:09.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66162025-08-01T16:06:09.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66172025-08-01T16:06:09.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66182025-08-01T16:06:09.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66192025-08-01T16:06:09.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66202025-08-01T16:06:09.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66212025-08-01T16:06:09.763ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.432244ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66222025-08-01T16:06:09.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
66232025-08-01T16:06:09.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
66242025-08-01T16:06:09.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
66252025-08-01T16:06:09.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66262025-08-01T16:06:09.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66272025-08-01T16:06:09.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66282025-08-01T16:06:09.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
66292025-08-01T16:06:09.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.119576ms iteration = 101 status = {"chicken_switches_updated":false}
66302025-08-01T16:06:09.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66312025-08-01T16:06:09.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66322025-08-01T16:06:09.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66332025-08-01T16:06:09.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
66342025-08-01T16:06:09.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66352025-08-01T16:06:09.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66362025-08-01T16:06:09.782ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
66372025-08-01T16:06:09.782ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.643697ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
66382025-08-01T16:06:09.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 856 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 25846017-65a1-40e7-9838-4265765a9d12 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
66392025-08-01T16:06:10.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ae7d1d7f-a0f2-4983-90e3-d2d5113323fc roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66402025-08-01T16:06:10.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ae7d1d7f-a0f2-4983-90e3-d2d5113323fc resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66412025-08-01T16:06:10.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2277 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ae7d1d7f-a0f2-4983-90e3-d2d5113323fc response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66422025-08-01T16:06:11.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 70d41c4e-d5f5-4daf-99d6-7586ed280fe8 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66432025-08-01T16:06:11.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 70d41c4e-d5f5-4daf-99d6-7586ed280fe8 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66442025-08-01T16:06:11.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2366 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 70d41c4e-d5f5-4daf-99d6-7586ed280fe8 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66452025-08-01T16:06:12.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 201647a8-6642-40b9-8036-a94ad3ccd401 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66462025-08-01T16:06:12.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 201647a8-6642-40b9-8036-a94ad3ccd401 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66472025-08-01T16:06:12.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2260 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 201647a8-6642-40b9-8036-a94ad3ccd401 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66482025-08-01T16:06:13.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 95bd8e9f-0248-4ebd-a203-97821bbf96e3 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66492025-08-01T16:06:13.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 95bd8e9f-0248-4ebd-a203-97821bbf96e3 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66502025-08-01T16:06:13.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2038 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 95bd8e9f-0248-4ebd-a203-97821bbf96e3 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66512025-08-01T16:06:14.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2efcfb1a-cc23-4ec1-a9e7-daa0dcbb6d87 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66522025-08-01T16:06:14.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2efcfb1a-cc23-4ec1-a9e7-daa0dcbb6d87 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66532025-08-01T16:06:14.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2405 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2efcfb1a-cc23-4ec1-a9e7-daa0dcbb6d87 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66542025-08-01T16:06:14.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 102 reason = Timeout
66552025-08-01T16:06:14.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
66562025-08-01T16:06:14.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
66572025-08-01T16:06:14.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66582025-08-01T16:06:14.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
66592025-08-01T16:06:14.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
66602025-08-01T16:06:14.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
66612025-08-01T16:06:14.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
66622025-08-01T16:06:14.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.777116ms iteration = 102 status = {"chicken_switches_updated":false}
66632025-08-01T16:06:15.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b173ffb0-8ebc-4e65-8bde-6e076ba54360 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66642025-08-01T16:06:15.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b173ffb0-8ebc-4e65-8bde-6e076ba54360 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66652025-08-01T16:06:15.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2312 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b173ffb0-8ebc-4e65-8bde-6e076ba54360 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66662025-08-01T16:06:16.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9272064d-aee9-4922-81c9-a708e5c28d2f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66672025-08-01T16:06:16.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9272064d-aee9-4922-81c9-a708e5c28d2f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66682025-08-01T16:06:16.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2046 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9272064d-aee9-4922-81c9-a708e5c28d2f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66692025-08-01T16:06:17.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6f2aa974-4061-4752-959e-8b47f5c000a5 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66702025-08-01T16:06:17.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6f2aa974-4061-4752-959e-8b47f5c000a5 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66712025-08-01T16:06:17.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2616 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6f2aa974-4061-4752-959e-8b47f5c000a5 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66722025-08-01T16:06:18.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 020c24ca-31c3-4f87-8159-aede0abecaad roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66732025-08-01T16:06:18.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 020c24ca-31c3-4f87-8159-aede0abecaad resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66742025-08-01T16:06:18.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2288 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 020c24ca-31c3-4f87-8159-aede0abecaad response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66752025-08-01T16:06:19.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 73338ec5-cba6-4c1a-bead-896d3ee67822 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66762025-08-01T16:06:19.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 73338ec5-cba6-4c1a-bead-896d3ee67822 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66772025-08-01T16:06:19.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2211 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 73338ec5-cba6-4c1a-bead-896d3ee67822 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
66782025-08-01T16:06:19.688ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
66792025-08-01T16:06:19.688ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
66802025-08-01T16:06:19.688ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
66812025-08-01T16:06:19.688ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
66822025-08-01T16:06:19.688ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66832025-08-01T16:06:19.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
66842025-08-01T16:06:19.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66852025-08-01T16:06:19.691ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.715232ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
66862025-08-01T16:06:19.691ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44075, tv_nsec: 707108002 } })
66872025-08-01T16:06:19.691ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44075, tv_nsec: 707332109 } })
66882025-08-01T16:06:19.691ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
66892025-08-01T16:06:19.691ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
66902025-08-01T16:06:19.751ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
66912025-08-01T16:06:19.751ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66922025-08-01T16:06:19.751ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "22601045-914a-403d-a149-83e80cdb9500", "content-length": "26", "date": "Fri, 01 Aug 2025 16:06:19 GMT"} })
66932025-08-01T16:06:19.752ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66942025-08-01T16:06:19.752ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
66952025-08-01T16:06:19.752ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66962025-08-01T16:06:19.752ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1608477a-7937-4b36-93f1-e73d1f95bd6f", "content-length": "26", "date": "Fri, 01 Aug 2025 16:06:19 GMT"} })
66972025-08-01T16:06:19.752ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66982025-08-01T16:06:19.753ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66992025-08-01T16:06:19.754ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67002025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 18 reason = Timeout
67012025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
67022025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
67032025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67042025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 17.671\u{b5}s iteration = 18 status = {"disabled":true,"errors":[],"sps":[]}
67052025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
67062025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
67072025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67082025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67092025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67102025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
67112025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67122025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
67132025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
67142025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
67152025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
67162025-08-01T16:06:19.759ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
67172025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67182025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67192025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 18 reason = Timeout
67202025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
67212025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
67222025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
67232025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67242025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
67252025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67262025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
67272025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67282025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 103 reason = Timeout
67292025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
67302025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
67312025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
67322025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
67332025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67342025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67352025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67362025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67372025-08-01T16:06:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67382025-08-01T16:06:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67392025-08-01T16:06:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67402025-08-01T16:06:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67412025-08-01T16:06:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67422025-08-01T16:06:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67432025-08-01T16:06:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
67442025-08-01T16:06:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67452025-08-01T16:06:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
67462025-08-01T16:06:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67472025-08-01T16:06:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
67482025-08-01T16:06:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
67492025-08-01T16:06:19.761ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 18 reason = Timeout
67502025-08-01T16:06:19.761ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
67512025-08-01T16:06:19.761ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
67522025-08-01T16:06:19.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67532025-08-01T16:06:19.761ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67542025-08-01T16:06:19.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
67552025-08-01T16:06:19.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67562025-08-01T16:06:19.763ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67572025-08-01T16:06:19.764ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67582025-08-01T16:06:19.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
67592025-08-01T16:06:19.765ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67602025-08-01T16:06:19.765ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67612025-08-01T16:06:19.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67622025-08-01T16:06:19.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67632025-08-01T16:06:19.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67642025-08-01T16:06:19.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67652025-08-01T16:06:19.767ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67662025-08-01T16:06:19.767ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67672025-08-01T16:06:19.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67682025-08-01T16:06:19.768ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67692025-08-01T16:06:19.768ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67702025-08-01T16:06:19.768ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67712025-08-01T16:06:19.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67722025-08-01T16:06:19.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67732025-08-01T16:06:19.768ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67742025-08-01T16:06:19.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
67752025-08-01T16:06:19.769ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67762025-08-01T16:06:19.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67772025-08-01T16:06:19.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67782025-08-01T16:06:19.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
67792025-08-01T16:06:19.771ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67802025-08-01T16:06:19.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67812025-08-01T16:06:19.771ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67822025-08-01T16:06:19.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67832025-08-01T16:06:19.772ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67842025-08-01T16:06:19.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
67852025-08-01T16:06:19.773ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
67862025-08-01T16:06:19.773ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67872025-08-01T16:06:19.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
67882025-08-01T16:06:19.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67892025-08-01T16:06:19.774ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44075, tv_nsec: 790333466 } })
67902025-08-01T16:06:19.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67912025-08-01T16:06:19.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67922025-08-01T16:06:19.775ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
67932025-08-01T16:06:19.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67942025-08-01T16:06:19.775ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67952025-08-01T16:06:19.775ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67962025-08-01T16:06:19.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67972025-08-01T16:06:19.776ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
67982025-08-01T16:06:19.776ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 16.707107ms iteration = 103 status = {"chicken_switches_updated":false}
67992025-08-01T16:06:19.777ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68002025-08-01T16:06:19.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68012025-08-01T16:06:19.779ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68022025-08-01T16:06:19.784ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
68032025-08-01T16:06:19.784ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68042025-08-01T16:06:19.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68052025-08-01T16:06:19.809ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
68062025-08-01T16:06:19.809ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.593173ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
68072025-08-01T16:06:19.825ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68082025-08-01T16:06:19.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68092025-08-01T16:06:19.827ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 68.25749ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
68102025-08-01T16:06:19.828ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 68.898359ms iteration = 18 status = {"errors":[],"requests_created_ok":[]}
68112025-08-01T16:06:19.833ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68122025-08-01T16:06:19.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68132025-08-01T16:06:19.834ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68142025-08-01T16:06:19.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68152025-08-01T16:06:19.836ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 77.359046ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
68162025-08-01T16:06:19.836ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68172025-08-01T16:06:19.836ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
68182025-08-01T16:06:19.836ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68192025-08-01T16:06:19.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68202025-08-01T16:06:19.837ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 78.463789ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
68212025-08-01T16:06:19.840ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68222025-08-01T16:06:19.840ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
68232025-08-01T16:06:19.840ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68242025-08-01T16:06:19.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68252025-08-01T16:06:19.844ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68262025-08-01T16:06:19.844ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 85.09247ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
68272025-08-01T16:06:19.847ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68282025-08-01T16:06:19.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68292025-08-01T16:06:19.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
68302025-08-01T16:06:19.848ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
68312025-08-01T16:06:19.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
68322025-08-01T16:06:19.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68332025-08-01T16:06:19.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68342025-08-01T16:06:19.851ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
68352025-08-01T16:06:19.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
68362025-08-01T16:06:19.852ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 92.531926ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
68372025-08-01T16:06:19.852ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68382025-08-01T16:06:19.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68392025-08-01T16:06:19.853ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68402025-08-01T16:06:19.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68412025-08-01T16:06:19.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68422025-08-01T16:06:19.856ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
68432025-08-01T16:06:19.856ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 97.431124ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
68442025-08-01T16:06:19.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68452025-08-01T16:06:19.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
68462025-08-01T16:06:19.857ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
68472025-08-01T16:06:19.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
68482025-08-01T16:06:19.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
68492025-08-01T16:06:19.858ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68502025-08-01T16:06:19.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68512025-08-01T16:06:19.860ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 100.879928ms iteration = 18 status = 0
68522025-08-01T16:06:19.870ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 182.118572ms iteration = 18 status = {}
68532025-08-01T16:06:19.895ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68542025-08-01T16:06:19.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
68552025-08-01T16:06:19.906ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 217.460353ms iteration = 18 status = null
68562025-08-01T16:06:19.908ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 148.557935ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68572025-08-01T16:06:19.917ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68582025-08-01T16:06:19.917ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
68592025-08-01T16:06:19.917ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 157.518806ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
68602025-08-01T16:06:19.919ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:391
68612025-08-01T16:06:19.919ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 158.444444ms iteration = 18 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
68622025-08-01T16:06:19.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 708 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = fe186caa-38fd-4b93-a5b8-d2203fdefe71 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
68632025-08-01T16:06:19.924ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 164.642193ms iteration = 20 status = {"physical_disks_added":0}
68642025-08-01T16:06:19.931ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 zone_address = fd00:1122:3344:101::2
68652025-08-01T16:06:19.931ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68662025-08-01T16:06:19.931ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "292fc590-6e60-41f9-976b-1f44a40ed937", "content-length": "26", "date": "Fri, 01 Aug 2025 16:06:19 GMT"} })
68672025-08-01T16:06:19.931ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68682025-08-01T16:06:19.933ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
68692025-08-01T16:06:19.957ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
68702025-08-01T16:06:19.957ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68712025-08-01T16:06:19.958ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c8cd24d-b542-48c4-8096-750aaf02eba6", "content-length": "372", "date": "Fri, 01 Aug 2025 16:06:19 GMT"} })
68722025-08-01T16:06:19.958ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68732025-08-01T16:06:19.958ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68742025-08-01T16:06:19.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68752025-08-01T16:06:19.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68762025-08-01T16:06:19.970ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68772025-08-01T16:06:19.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68782025-08-01T16:06:19.975ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68792025-08-01T16:06:19.982ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68802025-08-01T16:06:19.982ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68812025-08-01T16:06:19.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68822025-08-01T16:06:19.985ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68832025-08-01T16:06:19.989ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68842025-08-01T16:06:19.989ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68852025-08-01T16:06:19.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68862025-08-01T16:06:19.992ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
68872025-08-01T16:06:19.992ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
68882025-08-01T16:06:19.992ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b0acf503-606a-49b8-b83f-13342bb99138", "date": "Fri, 01 Aug 2025 16:06:19 GMT"} })
68892025-08-01T16:06:19.992ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68902025-08-01T16:06:19.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68912025-08-01T16:06:19.995ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68922025-08-01T16:06:19.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68932025-08-01T16:06:19.999ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68942025-08-01T16:06:19.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68952025-08-01T16:06:20.004ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
68962025-08-01T16:06:20.004ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68972025-08-01T16:06:20.004ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "93236cc7-d7b5-4d53-a7b5-b5fe82632e08", "date": "Fri, 01 Aug 2025 16:06:20 GMT"} })
68982025-08-01T16:06:20.006ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 247.205996ms iteration = 18 status = {}
68992025-08-01T16:06:20.067ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
69002025-08-01T16:06:20.067ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "55df5b04-c8ef-4bec-8b5e-3eaace0ba509", "content-length": "691", "date": "Fri, 01 Aug 2025 16:06:20 GMT"} })
69012025-08-01T16:06:20.067ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
69022025-08-01T16:06:20.068ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
69032025-08-01T16:06:20.068ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
69042025-08-01T16:06:20.070ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 310.561296ms iteration = 18 status = {}
69052025-08-01T16:06:20.102ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69062025-08-01T16:06:20.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69072025-08-01T16:06:20.106ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 3f21d9d5-3adf-463a-a05d-bc2e2e5d64ca, rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(4c7da70d-ede0-4107-abc5-5650a053be38) } rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
69082025-08-01T16:06:20.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69092025-08-01T16:06:20.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69102025-08-01T16:06:20.120ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
69112025-08-01T16:06:20.120ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 4c7da70d-ede0-4107-abc5-5650a053be38
69122025-08-01T16:06:20.120ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
69132025-08-01T16:06:20.120ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
69142025-08-01T16:06:20.120ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69152025-08-01T16:06:20.120ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69162025-08-01T16:06:20.120ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69172025-08-01T16:06:20.120ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
69182025-08-01T16:06:20.120ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69192025-08-01T16:06:20.120ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
69202025-08-01T16:06:20.121ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
69212025-08-01T16:06:20.121ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69222025-08-01T16:06:20.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69232025-08-01T16:06:20.124ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
69242025-08-01T16:06:20.124ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
69252025-08-01T16:06:20.322ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "10e5da44-7900-417b-b026-79ff8a32a41e", "date": "Fri, 01 Aug 2025 16:06:20 GMT"} })
69262025-08-01T16:06:20.322ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch = Switch0
69272025-08-01T16:06:20.322ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
69282025-08-01T16:06:20.322ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9fbec551-2fe6-4fb4-8fcd-14387037beae", "content-length": "682", "date": "Fri, 01 Aug 2025 16:06:19 GMT"} })
69292025-08-01T16:06:20.322ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69302025-08-01T16:06:20.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69312025-08-01T16:06:20.326ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69322025-08-01T16:06:20.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69332025-08-01T16:06:20.329ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69342025-08-01T16:06:20.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69352025-08-01T16:06:20.331ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69362025-08-01T16:06:20.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69372025-08-01T16:06:20.338ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 579.025496ms iteration = 18 status = {}
69382025-08-01T16:06:20.653ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 3
69392025-08-01T16:06:20.653ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221
69402025-08-01T16:06:20.685ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
69412025-08-01T16:06:20.685ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:54298
69422025-08-01T16:06:20.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:54298 req_id = f0443652-cbac-4953-987a-2b3a910b9f26 roles = RoleSet { roles: {} } uri = /metrics/producers
69432025-08-01T16:06:20.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:54298 req_id = f0443652-cbac-4953-987a-2b3a910b9f26 resource = Database result = Ok(()) uri = /metrics/producers
69442025-08-01T16:06:20.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 580ce62d-0716-4fdd-8376-fac2f77fecea roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
69452025-08-01T16:06:20.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 580ce62d-0716-4fdd-8376-fac2f77fecea resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
69462025-08-01T16:06:20.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2402 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 580ce62d-0716-4fdd-8376-fac2f77fecea response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
69472025-08-01T16:06:20.727ZINFOnexus: assigned collector to new producer collector_id = 7bf2727d-8ae8-417c-81cf-59aa0ad1690b file = nexus/src/app/oximeter.rs:76 producer_id = 7248190d-c184-423c-8431-31fe40a79e2e
69482025-08-01T16:06:20.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 42255 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:54298 req_id = f0443652-cbac-4953-987a-2b3a910b9f26 response_code = 201 uri = /metrics/producers
69492025-08-01T16:06:20.727ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "f0443652-cbac-4953-987a-2b3a910b9f26", "content-length": "41", "date": "Fri, 01 Aug 2025 16:06:20 GMT"} })
69502025-08-01T16:06:20.729ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
69512025-08-01T16:06:21.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7d165ee9-4728-46c4-8f3d-59c5c4a13db5 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
69522025-08-01T16:06:21.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7d165ee9-4728-46c4-8f3d-59c5c4a13db5 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
69532025-08-01T16:06:21.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1923 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7d165ee9-4728-46c4-8f3d-59c5c4a13db5 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
69542025-08-01T16:06:22.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1f85a7c5-c2cf-464a-afab-73064770725e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
69552025-08-01T16:06:22.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1f85a7c5-c2cf-464a-afab-73064770725e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
69562025-08-01T16:06:22.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2626 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1f85a7c5-c2cf-464a-afab-73064770725e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
69572025-08-01T16:06:23.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 83c563a7-68d2-4d10-bcc8-f286c8ff73b6 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
69582025-08-01T16:06:23.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 83c563a7-68d2-4d10-bcc8-f286c8ff73b6 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
69592025-08-01T16:06:23.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2144 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 83c563a7-68d2-4d10-bcc8-f286c8ff73b6 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
69602025-08-01T16:06:24.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 104 reason = Timeout
69612025-08-01T16:06:24.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
69622025-08-01T16:06:24.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
69632025-08-01T16:06:24.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69642025-08-01T16:06:24.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2c29f7f2-ef12-4d5a-b635-b1fd00062766 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
69652025-08-01T16:06:24.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2c29f7f2-ef12-4d5a-b635-b1fd00062766 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
69662025-08-01T16:06:24.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
69672025-08-01T16:06:24.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
69682025-08-01T16:06:24.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
69692025-08-01T16:06:24.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2472 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2c29f7f2-ef12-4d5a-b635-b1fd00062766 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
69702025-08-01T16:06:24.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
69712025-08-01T16:06:24.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.511208ms iteration = 104 status = {"chicken_switches_updated":false}
69722025-08-01T16:06:25.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 441fc929-3f73-4d0f-9444-1c90023facdd roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
69732025-08-01T16:06:25.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 441fc929-3f73-4d0f-9444-1c90023facdd resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
69742025-08-01T16:06:25.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2414 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 441fc929-3f73-4d0f-9444-1c90023facdd response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
69752025-08-01T16:06:26.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 82b77e75-74b6-43e1-9072-3f42806e1146 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
69762025-08-01T16:06:26.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 82b77e75-74b6-43e1-9072-3f42806e1146 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
69772025-08-01T16:06:26.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2514 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 82b77e75-74b6-43e1-9072-3f42806e1146 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
69782025-08-01T16:06:27.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e122887f-0f66-4ff5-907f-7fb6c506c581 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
69792025-08-01T16:06:27.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e122887f-0f66-4ff5-907f-7fb6c506c581 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
69802025-08-01T16:06:27.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2435 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e122887f-0f66-4ff5-907f-7fb6c506c581 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
69812025-08-01T16:06:28.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 69fc2b6d-cb7b-4523-8c74-52ce75947fdb roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
69822025-08-01T16:06:28.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 69fc2b6d-cb7b-4523-8c74-52ce75947fdb resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
69832025-08-01T16:06:28.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2516 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 69fc2b6d-cb7b-4523-8c74-52ce75947fdb response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
69842025-08-01T16:06:29.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
69852025-08-01T16:06:29.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 105 reason = Timeout
69862025-08-01T16:06:29.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69872025-08-01T16:06:29.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
69882025-08-01T16:06:29.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69892025-08-01T16:06:29.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
69902025-08-01T16:06:29.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
69912025-08-01T16:06:29.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69922025-08-01T16:06:29.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69932025-08-01T16:06:29.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69942025-08-01T16:06:29.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69952025-08-01T16:06:29.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69962025-08-01T16:06:29.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69972025-08-01T16:06:29.763ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.428884ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69982025-08-01T16:06:29.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
69992025-08-01T16:06:29.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
70002025-08-01T16:06:29.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
70012025-08-01T16:06:29.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70022025-08-01T16:06:29.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70032025-08-01T16:06:29.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70042025-08-01T16:06:29.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
70052025-08-01T16:06:29.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.406715ms iteration = 105 status = {"chicken_switches_updated":false}
70062025-08-01T16:06:29.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70072025-08-01T16:06:29.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70082025-08-01T16:06:29.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70092025-08-01T16:06:29.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
70102025-08-01T16:06:29.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70112025-08-01T16:06:29.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70122025-08-01T16:06:29.783ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
70132025-08-01T16:06:29.783ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.274896ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
70142025-08-01T16:06:29.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 67671acd-7a3d-4976-914d-e8363299b548 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70152025-08-01T16:06:29.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 67671acd-7a3d-4976-914d-e8363299b548 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70162025-08-01T16:06:29.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1983 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 67671acd-7a3d-4976-914d-e8363299b548 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70172025-08-01T16:06:29.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 882 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = e4f84765-98fd-4444-a6b8-189d2231c6c2 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
70182025-08-01T16:06:30.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 26d96353-f68e-40d9-a0b0-d2099a07f54e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70192025-08-01T16:06:30.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 26d96353-f68e-40d9-a0b0-d2099a07f54e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70202025-08-01T16:06:30.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2184 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 26d96353-f68e-40d9-a0b0-d2099a07f54e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70212025-08-01T16:06:31.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4d6a30ce-c276-43e6-81b1-26b355465e31 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70222025-08-01T16:06:31.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4d6a30ce-c276-43e6-81b1-26b355465e31 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70232025-08-01T16:06:31.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2136 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4d6a30ce-c276-43e6-81b1-26b355465e31 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70242025-08-01T16:06:32.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f27b8c1d-ed20-4bfe-a614-47b0664b20eb roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70252025-08-01T16:06:32.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f27b8c1d-ed20-4bfe-a614-47b0664b20eb resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70262025-08-01T16:06:32.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2204 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f27b8c1d-ed20-4bfe-a614-47b0664b20eb response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70272025-08-01T16:06:33.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9b0bb24c-5285-4960-b4ab-5ab5aa1d8a05 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70282025-08-01T16:06:33.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9b0bb24c-5285-4960-b4ab-5ab5aa1d8a05 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70292025-08-01T16:06:33.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2296 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9b0bb24c-5285-4960-b4ab-5ab5aa1d8a05 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70302025-08-01T16:06:34.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 106 reason = Timeout
70312025-08-01T16:06:34.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
70322025-08-01T16:06:34.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
70332025-08-01T16:06:34.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70342025-08-01T16:06:34.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
70352025-08-01T16:06:34.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
70362025-08-01T16:06:34.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
70372025-08-01T16:06:34.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
70382025-08-01T16:06:34.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.311462ms iteration = 106 status = {"chicken_switches_updated":false}
70392025-08-01T16:06:34.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e7a05204-3564-4c22-ac54-57bc9b92f468 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70402025-08-01T16:06:34.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e7a05204-3564-4c22-ac54-57bc9b92f468 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70412025-08-01T16:06:34.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1938 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e7a05204-3564-4c22-ac54-57bc9b92f468 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70422025-08-01T16:06:35.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f11432bb-c238-4e25-9816-4bc1d0e81480 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70432025-08-01T16:06:35.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f11432bb-c238-4e25-9816-4bc1d0e81480 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70442025-08-01T16:06:35.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2279 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f11432bb-c238-4e25-9816-4bc1d0e81480 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70452025-08-01T16:06:36.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9f4ee642-30d9-45c8-adbf-cfd54ac5b392 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70462025-08-01T16:06:36.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9f4ee642-30d9-45c8-adbf-cfd54ac5b392 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70472025-08-01T16:06:36.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2027 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9f4ee642-30d9-45c8-adbf-cfd54ac5b392 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70482025-08-01T16:06:37.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f5ee07d1-b39e-4237-bfe6-337036b53859 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70492025-08-01T16:06:37.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f5ee07d1-b39e-4237-bfe6-337036b53859 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70502025-08-01T16:06:37.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2166 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f5ee07d1-b39e-4237-bfe6-337036b53859 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70512025-08-01T16:06:38.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d831e2ec-ca4e-43c1-ac39-34ea061c675a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70522025-08-01T16:06:38.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d831e2ec-ca4e-43c1-ac39-34ea061c675a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70532025-08-01T16:06:38.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2467 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d831e2ec-ca4e-43c1-ac39-34ea061c675a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70542025-08-01T16:06:39.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
70552025-08-01T16:06:39.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70562025-08-01T16:06:39.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 107 reason = Timeout
70572025-08-01T16:06:39.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
70582025-08-01T16:06:39.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70592025-08-01T16:06:39.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
70602025-08-01T16:06:39.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
70612025-08-01T16:06:39.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70622025-08-01T16:06:39.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70632025-08-01T16:06:39.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70642025-08-01T16:06:39.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70652025-08-01T16:06:39.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70662025-08-01T16:06:39.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70672025-08-01T16:06:39.762ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.253619ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70682025-08-01T16:06:39.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70692025-08-01T16:06:39.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70702025-08-01T16:06:39.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
70712025-08-01T16:06:39.765ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
70722025-08-01T16:06:39.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70732025-08-01T16:06:39.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
70742025-08-01T16:06:39.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70752025-08-01T16:06:39.767ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
70762025-08-01T16:06:39.767ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.561739ms iteration = 107 status = {"chicken_switches_updated":false}
70772025-08-01T16:06:39.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70782025-08-01T16:06:39.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70792025-08-01T16:06:39.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
70802025-08-01T16:06:39.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70812025-08-01T16:06:39.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70822025-08-01T16:06:39.786ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
70832025-08-01T16:06:39.786ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.175714ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
70842025-08-01T16:06:39.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 623 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 831f4ccb-b15d-4c5e-ad13-88f62f61a09c response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
70852025-08-01T16:06:40.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 423180c7-f26f-451c-abd7-cb802d28e1c2 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70862025-08-01T16:06:40.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 423180c7-f26f-451c-abd7-cb802d28e1c2 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70872025-08-01T16:06:40.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2465 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 423180c7-f26f-451c-abd7-cb802d28e1c2 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70882025-08-01T16:06:41.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 45c1807c-b59e-44b7-9d29-3372f2b95a18 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70892025-08-01T16:06:41.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 45c1807c-b59e-44b7-9d29-3372f2b95a18 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70902025-08-01T16:06:41.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2109 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 45c1807c-b59e-44b7-9d29-3372f2b95a18 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70912025-08-01T16:06:42.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 92efab16-1142-477a-9322-779555ee0f0d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70922025-08-01T16:06:42.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 92efab16-1142-477a-9322-779555ee0f0d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70932025-08-01T16:06:42.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2048 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 92efab16-1142-477a-9322-779555ee0f0d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70942025-08-01T16:06:43.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6502aac5-c169-4496-9bbe-ca13119690f9 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70952025-08-01T16:06:43.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6502aac5-c169-4496-9bbe-ca13119690f9 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70962025-08-01T16:06:43.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2212 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6502aac5-c169-4496-9bbe-ca13119690f9 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70972025-08-01T16:06:44.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 484b362b-05cf-4823-8930-3011bb57e6bb roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70982025-08-01T16:06:44.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 484b362b-05cf-4823-8930-3011bb57e6bb resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
70992025-08-01T16:06:44.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2170 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 484b362b-05cf-4823-8930-3011bb57e6bb response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
71002025-08-01T16:06:44.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 108 reason = Timeout
71012025-08-01T16:06:44.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
71022025-08-01T16:06:44.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
71032025-08-01T16:06:44.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71042025-08-01T16:06:44.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
71052025-08-01T16:06:44.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
71062025-08-01T16:06:44.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
71072025-08-01T16:06:44.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
71082025-08-01T16:06:44.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.754115ms iteration = 108 status = {"chicken_switches_updated":false}
71092025-08-01T16:06:45.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 13b69753-6f72-428d-846c-de2283f5d57b roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
71102025-08-01T16:06:45.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 13b69753-6f72-428d-846c-de2283f5d57b resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
71112025-08-01T16:06:45.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2095 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 13b69753-6f72-428d-846c-de2283f5d57b response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
71122025-08-01T16:06:46.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0496fb41-acb5-4d8b-aafe-858e3b42aaa4 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
71132025-08-01T16:06:46.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0496fb41-acb5-4d8b-aafe-858e3b42aaa4 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
71142025-08-01T16:06:46.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2129 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0496fb41-acb5-4d8b-aafe-858e3b42aaa4 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
71152025-08-01T16:06:47.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 250af728-0b66-401b-927d-27d5486af1d1 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
71162025-08-01T16:06:47.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 250af728-0b66-401b-927d-27d5486af1d1 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
71172025-08-01T16:06:47.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2648 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 250af728-0b66-401b-927d-27d5486af1d1 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
71182025-08-01T16:06:48.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0eb1d876-70ad-46b4-81b1-1c0449daacf3 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
71192025-08-01T16:06:48.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0eb1d876-70ad-46b4-81b1-1c0449daacf3 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
71202025-08-01T16:06:48.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2310 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0eb1d876-70ad-46b4-81b1-1c0449daacf3 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
71212025-08-01T16:06:49.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c36477a0-8dec-4a9c-8a62-ac86e0c9b03e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
71222025-08-01T16:06:49.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c36477a0-8dec-4a9c-8a62-ac86e0c9b03e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
71232025-08-01T16:06:49.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2875 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c36477a0-8dec-4a9c-8a62-ac86e0c9b03e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
71242025-08-01T16:06:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
71252025-08-01T16:06:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
71262025-08-01T16:06:49.688ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
71272025-08-01T16:06:49.688ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
71282025-08-01T16:06:49.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71292025-08-01T16:06:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
71302025-08-01T16:06:49.688ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
71312025-08-01T16:06:49.688ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-01 15:56:49.688268937 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
71322025-08-01T16:06:49.688ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
71332025-08-01T16:06:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
71342025-08-01T16:06:49.688ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
71352025-08-01T16:06:49.688ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
71362025-08-01T16:06:49.688ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
71372025-08-01T16:06:49.688ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
71382025-08-01T16:06:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
71392025-08-01T16:06:49.688ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
71402025-08-01T16:06:49.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
71412025-08-01T16:06:49.688ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
71422025-08-01T16:06:49.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71432025-08-01T16:06:49.688ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71442025-08-01T16:06:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71452025-08-01T16:06:49.688ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cb706a84-a33b-442f-aac2-3a6eb5f3b330.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d688a68d-d771-4ac5-8e66-9efa94dbbea8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d688a68d-d771-4ac5-8e66-9efa94dbbea8.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 44105, tv_nsec: 705076375 } })
71462025-08-01T16:06:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
71472025-08-01T16:06:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71482025-08-01T16:06:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
71492025-08-01T16:06:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71502025-08-01T16:06:49.688ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50fe31de-3241-42df-a386-de37ce323a34.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("58598327-8751-423c-a5ac-c610829651e2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 44105, tv_nsec: 705182308 } })
71512025-08-01T16:06:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71522025-08-01T16:06:49.689ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
71532025-08-01T16:06:49.689ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 958.479\u{b5}s iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
71542025-08-01T16:06:49.689ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
71552025-08-01T16:06:49.689ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.026741ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
71562025-08-01T16:06:49.689ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71572025-08-01T16:06:49.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71582025-08-01T16:06:49.690ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71592025-08-01T16:06:49.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71602025-08-01T16:06:49.690ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44105, tv_nsec: 707165018 } })
71612025-08-01T16:06:49.691ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
71622025-08-01T16:06:49.691ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.526197ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
71632025-08-01T16:06:49.691ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-01 15:56:49.688268937 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
71642025-08-01T16:06:49.691ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.575708ms iteration = 10 status = {"expiration":"2025-08-01T15:56:49.688268937Z","pruned":[]}
71652025-08-01T16:06:49.692ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71662025-08-01T16:06:49.692ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44105, tv_nsec: 709339894 } })
71672025-08-01T16:06:49.693ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
71682025-08-01T16:06:49.693ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71692025-08-01T16:06:49.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
71702025-08-01T16:06:49.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71712025-08-01T16:06:49.698ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
71722025-08-01T16:06:49.698ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
71732025-08-01T16:06:49.698ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
71742025-08-01T16:06:49.698ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71752025-08-01T16:06:49.698ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
71762025-08-01T16:06:49.698ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
71772025-08-01T16:06:49.698ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
71782025-08-01T16:06:49.698ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71792025-08-01T16:06:49.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71802025-08-01T16:06:49.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71812025-08-01T16:06:49.700ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71822025-08-01T16:06:49.700ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71832025-08-01T16:06:49.704ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71842025-08-01T16:06:49.704ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71852025-08-01T16:06:49.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71862025-08-01T16:06:49.705ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
71872025-08-01T16:06:49.705ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71882025-08-01T16:06:49.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71892025-08-01T16:06:49.706ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
71902025-08-01T16:06:49.706ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1
71912025-08-01T16:06:49.706ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.55\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1"}
71922025-08-01T16:06:49.707ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
71932025-08-01T16:06:49.707ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6482e44c-c860-4033-b945-5707d343a59d dns_zone_name = oxide.test found_so_far = 0 version = 2
71942025-08-01T16:06:49.707ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71952025-08-01T16:06:49.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71962025-08-01T16:06:49.707ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
71972025-08-01T16:06:49.707ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 02fcb774-aa43-4052-9996-b85e2d1358b5 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
71982025-08-01T16:06:49.707ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71992025-08-01T16:06:49.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72002025-08-01T16:06:49.709ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72012025-08-01T16:06:49.709ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72022025-08-01T16:06:49.709ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
72032025-08-01T16:06:49.709ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 13 reason = Timeout
72042025-08-01T16:06:49.709ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
72052025-08-01T16:06:49.709ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72062025-08-01T16:06:49.709ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 8.77\u{b5}s iteration = 13 status = "Disabled"
72072025-08-01T16:06:49.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72082025-08-01T16:06:49.709ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72092025-08-01T16:06:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72102025-08-01T16:06:49.710ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72112025-08-01T16:06:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72122025-08-01T16:06:49.710ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72132025-08-01T16:06:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72142025-08-01T16:06:49.710ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72152025-08-01T16:06:49.710ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
72162025-08-01T16:06:49.710ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
72172025-08-01T16:06:49.710ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
72182025-08-01T16:06:49.710ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
72192025-08-01T16:06:49.710ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 10 reason = Timeout
72202025-08-01T16:06:49.710ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
72212025-08-01T16:06:49.710ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
72222025-08-01T16:06:49.710ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
72232025-08-01T16:06:49.710ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
72242025-08-01T16:06:49.710ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 10 reason = Timeout
72252025-08-01T16:06:49.710ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
72262025-08-01T16:06:49.710ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
72272025-08-01T16:06:49.710ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
72282025-08-01T16:06:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72292025-08-01T16:06:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
72302025-08-01T16:06:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
72312025-08-01T16:06:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
72322025-08-01T16:06:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
72332025-08-01T16:06:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
72342025-08-01T16:06:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
72352025-08-01T16:06:49.711ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72362025-08-01T16:06:49.713ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.521717ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
72372025-08-01T16:06:49.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
72382025-08-01T16:06:49.714ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72392025-08-01T16:06:49.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72402025-08-01T16:06:49.714ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
72412025-08-01T16:06:49.714ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 4.115005ms iteration = 10 status = {"by_rx":{},"error":null}
72422025-08-01T16:06:49.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
72432025-08-01T16:06:49.715ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72442025-08-01T16:06:49.715ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72452025-08-01T16:06:49.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72462025-08-01T16:06:49.715ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72472025-08-01T16:06:49.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
72482025-08-01T16:06:49.716ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72492025-08-01T16:06:49.716ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
72502025-08-01T16:06:49.716ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
72512025-08-01T16:06:49.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72522025-08-01T16:06:49.716ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 5.999242ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
72532025-08-01T16:06:49.717ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
72542025-08-01T16:06:49.718ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 02fcb774-aa43-4052-9996-b85e2d1358b5 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
72552025-08-01T16:06:49.718ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
72562025-08-01T16:06:49.718ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-01 15:58:34.032744 UTC dns_group = internal generation = 1
72572025-08-01T16:06:49.718ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 29.862835ms iteration = 10 status = {"generation":1}
72582025-08-01T16:06:49.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
72592025-08-01T16:06:49.718ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6482e44c-c860-4033-b945-5707d343a59d dns_zone_name = oxide.test found_so_far = 4 version = 2
72602025-08-01T16:06:49.718ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
72612025-08-01T16:06:49.718ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-01 15:58:34.713515 UTC dns_group = external generation = 2
72622025-08-01T16:06:49.718ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 29.827584ms iteration = 10 status = {"generation":2}
72632025-08-01T16:06:49.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
72642025-08-01T16:06:49.718ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
72652025-08-01T16:06:49.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
72662025-08-01T16:06:49.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
72672025-08-01T16:06:49.719ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72682025-08-01T16:06:49.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72692025-08-01T16:06:49.719ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72702025-08-01T16:06:49.720ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 10.190789ms iteration = 10 status = {"dispatched":[],"errors":[],"glob_version":"173.0.0","globs_reprocessed":{},"no_receivers":[]}
72712025-08-01T16:06:49.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
72722025-08-01T16:06:49.722ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72732025-08-01T16:06:49.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72742025-08-01T16:06:49.723ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72752025-08-01T16:06:49.725ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
72762025-08-01T16:06:49.725ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72772025-08-01T16:06:49.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72782025-08-01T16:06:49.725ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72792025-08-01T16:06:49.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
72802025-08-01T16:06:49.727ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72812025-08-01T16:06:49.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72822025-08-01T16:06:49.729ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 19.840032ms iteration = 5 status = {"nsuccess":5}
72832025-08-01T16:06:49.729ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72842025-08-01T16:06:49.731ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
72852025-08-01T16:06:49.731ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72862025-08-01T16:06:49.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72872025-08-01T16:06:49.734ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72882025-08-01T16:06:49.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72892025-08-01T16:06:49.735ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72902025-08-01T16:06:49.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
72912025-08-01T16:06:49.741ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72922025-08-01T16:06:49.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72932025-08-01T16:06:49.745ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72942025-08-01T16:06:49.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72952025-08-01T16:06:49.747ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72962025-08-01T16:06:49.751ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
72972025-08-01T16:06:49.751ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72982025-08-01T16:06:49.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72992025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 19 reason = Timeout
73002025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
73012025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
73022025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 25.851\u{b5}s iteration = 19 status = {"disabled":true,"errors":[],"sps":[]}
73032025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73042025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
73052025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
73062025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
73072025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
73082025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73092025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
73102025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
73112025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
73122025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
73132025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
73142025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
73152025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73162025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
73172025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
73182025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73192025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73202025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 109 reason = Timeout
73212025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
73222025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
73232025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73242025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
73252025-08-01T16:06:49.759ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
73262025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73272025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 19 reason = Timeout
73282025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
73292025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
73302025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73312025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
73322025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
73332025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 19 reason = Timeout
73342025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
73352025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
73362025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73372025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73382025-08-01T16:06:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
73392025-08-01T16:06:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
73402025-08-01T16:06:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73412025-08-01T16:06:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
73422025-08-01T16:06:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73432025-08-01T16:06:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
73442025-08-01T16:06:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
73452025-08-01T16:06:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73462025-08-01T16:06:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73472025-08-01T16:06:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73482025-08-01T16:06:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73492025-08-01T16:06:49.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
73502025-08-01T16:06:49.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73512025-08-01T16:06:49.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
73522025-08-01T16:06:49.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
73532025-08-01T16:06:49.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73542025-08-01T16:06:49.763ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73552025-08-01T16:06:49.764ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 5.174376ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
73562025-08-01T16:06:49.765ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73572025-08-01T16:06:49.767ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73582025-08-01T16:06:49.767ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73592025-08-01T16:06:49.767ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
73602025-08-01T16:06:49.767ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73612025-08-01T16:06:49.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73622025-08-01T16:06:49.767ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73632025-08-01T16:06:49.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
73642025-08-01T16:06:49.767ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
73652025-08-01T16:06:49.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73662025-08-01T16:06:49.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
73672025-08-01T16:06:49.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
73682025-08-01T16:06:49.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73692025-08-01T16:06:49.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73702025-08-01T16:06:49.769ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
73712025-08-01T16:06:49.769ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
73722025-08-01T16:06:49.769ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 59.02562ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
73732025-08-01T16:06:49.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73742025-08-01T16:06:49.770ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73752025-08-01T16:06:49.771ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 11.775877ms iteration = 19 status = {"errors":[],"requests_created_ok":[]}
73762025-08-01T16:06:49.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
73772025-08-01T16:06:49.772ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
73782025-08-01T16:06:49.772ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73792025-08-01T16:06:49.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
73802025-08-01T16:06:49.773ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73812025-08-01T16:06:49.774ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73822025-08-01T16:06:49.774ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73832025-08-01T16:06:49.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73842025-08-01T16:06:49.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73852025-08-01T16:06:49.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73862025-08-01T16:06:49.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73872025-08-01T16:06:49.776ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73882025-08-01T16:06:49.776ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
73892025-08-01T16:06:49.776ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73902025-08-01T16:06:49.776ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73912025-08-01T16:06:49.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73922025-08-01T16:06:49.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73932025-08-01T16:06:49.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
73942025-08-01T16:06:49.777ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
73952025-08-01T16:06:49.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
73962025-08-01T16:06:49.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73972025-08-01T16:06:49.777ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73982025-08-01T16:06:49.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73992025-08-01T16:06:49.783ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74002025-08-01T16:06:49.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74012025-08-01T16:06:49.791ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
74022025-08-01T16:06:49.791ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 32.204437ms iteration = 109 status = {"chicken_switches_updated":false}
74032025-08-01T16:06:49.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74042025-08-01T16:06:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74052025-08-01T16:06:49.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74062025-08-01T16:06:49.806ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
74072025-08-01T16:06:49.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
74082025-08-01T16:06:49.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74092025-08-01T16:06:49.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74102025-08-01T16:06:49.815ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
74112025-08-01T16:06:49.815ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74122025-08-01T16:06:49.815ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "93524996-2fdf-4650-b691-8da7fdcf454d", "content-length": "26", "date": "Fri, 01 Aug 2025 16:06:49 GMT"} })
74132025-08-01T16:06:49.815ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74142025-08-01T16:06:49.817ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
74152025-08-01T16:06:49.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74162025-08-01T16:06:49.820ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
74172025-08-01T16:06:49.820ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74182025-08-01T16:06:49.821ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "49d13324-a208-4dd6-8470-d31957a551e9", "content-length": "26", "date": "Fri, 01 Aug 2025 16:06:49 GMT"} })
74192025-08-01T16:06:49.821ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74202025-08-01T16:06:49.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
74212025-08-01T16:06:49.823ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74222025-08-01T16:06:49.823ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
74232025-08-01T16:06:49.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74242025-08-01T16:06:49.824ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
74252025-08-01T16:06:49.826ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
74262025-08-01T16:06:49.826ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 67.091944ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
74272025-08-01T16:06:49.833ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-01T15:57:44.766264Z, time_modified: 2025-08-01T15:57:44.766264Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: eec17da7-eb17-4917-8728-908698b69bbe, db_silo: Silo { identity: SiloIdentity { id: eec17da7-eb17-4917-8728-908698b69bbe, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-01T15:58:34.653875Z, time_modified: 2025-08-01T15:58:34.653875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: eec17da7-eb17-4917-8728-908698b69bbe, db_silo: Silo { identity: SiloIdentity { id: eec17da7-eb17-4917-8728-908698b69bbe, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-01T15:58:34.653875Z, time_modified: 2025-08-01T15:58:34.653875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575" }] }) }
74282025-08-01T16:06:49.833ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 144.892773ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"eec17da7-eb17-4917-8728-908698b69bbe","tls_certs":["b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575"]}},"default_endpoint":{"silo_id":"eec17da7-eb17-4917-8728-908698b69bbe","tls_certs":["b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
74292025-08-01T16:06:49.836ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 77.047676ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
74302025-08-01T16:06:49.837ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44105, tv_nsec: 854069662 } })
74312025-08-01T16:06:49.841ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
74322025-08-01T16:06:49.842ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74332025-08-01T16:06:49.842ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
74342025-08-01T16:06:49.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74352025-08-01T16:06:49.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
74362025-08-01T16:06:49.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74372025-08-01T16:06:49.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74382025-08-01T16:06:49.847ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
74392025-08-01T16:06:49.847ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74402025-08-01T16:06:49.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
74412025-08-01T16:06:49.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
74422025-08-01T16:06:49.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
74432025-08-01T16:06:49.849ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 90.36796ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
74442025-08-01T16:06:49.850ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
74452025-08-01T16:06:49.850ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 91.592077ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
74462025-08-01T16:06:49.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
74472025-08-01T16:06:49.851ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
74482025-08-01T16:06:49.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
74492025-08-01T16:06:49.855ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 96.056312ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74502025-08-01T16:06:49.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74512025-08-01T16:06:49.862ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
74522025-08-01T16:06:49.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74532025-08-01T16:06:49.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74542025-08-01T16:06:49.870ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74552025-08-01T16:06:49.870ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
74562025-08-01T16:06:49.870ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 111.083118ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
74572025-08-01T16:06:49.870ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74582025-08-01T16:06:49.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
74592025-08-01T16:06:49.873ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74602025-08-01T16:06:49.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74612025-08-01T16:06:49.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74622025-08-01T16:06:49.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74632025-08-01T16:06:49.876ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74642025-08-01T16:06:49.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74652025-08-01T16:06:49.879ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74662025-08-01T16:06:49.880ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 121.03729ms iteration = 21 status = {"physical_disks_added":0}
74672025-08-01T16:06:49.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
74682025-08-01T16:06:49.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74692025-08-01T16:06:49.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74702025-08-01T16:06:49.887ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 128.201007ms iteration = 19 status = 0
74712025-08-01T16:06:49.905ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
74722025-08-01T16:06:49.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
74732025-08-01T16:06:49.916ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 157.300939ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
74742025-08-01T16:06:49.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 763 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 17122e41-c1cb-4ea3-9d51-6448b6b1b797 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
74752025-08-01T16:06:49.921ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 162.208449ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
74762025-08-01T16:06:49.927ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:391
74772025-08-01T16:06:49.927ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 168.288093ms iteration = 19 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
74782025-08-01T16:06:49.983ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
74792025-08-01T16:06:49.985ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74802025-08-01T16:06:49.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74812025-08-01T16:06:49.986ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74822025-08-01T16:06:49.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74832025-08-01T16:06:49.987ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 299.447699ms iteration = 19 status = null
74842025-08-01T16:06:49.994ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74852025-08-01T16:06:49.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74862025-08-01T16:06:49.996ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74872025-08-01T16:06:50.000ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
74882025-08-01T16:06:50.000ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74892025-08-01T16:06:50.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74902025-08-01T16:06:50.002ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74912025-08-01T16:06:50.005ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
74922025-08-01T16:06:50.005ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74932025-08-01T16:06:50.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74942025-08-01T16:06:50.007ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
74952025-08-01T16:06:50.007ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3f21d59e-d40e-4a4e-9f06-44f1297adef6", "date": "Fri, 01 Aug 2025 16:06:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
74962025-08-01T16:06:50.007ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
74972025-08-01T16:06:50.009ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e995f2d8-9f0b-4f81-bf2a-280a51abbb51", "date": "Fri, 01 Aug 2025 16:06:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
74982025-08-01T16:06:50.009ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
74992025-08-01T16:06:50.014ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
75002025-08-01T16:06:50.014ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 326.230781ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
75012025-08-01T16:06:50.015ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 327.381507ms iteration = 19 status = {}
75022025-08-01T16:06:50.021ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 zone_address = fd00:1122:3344:101::2
75032025-08-01T16:06:50.021ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75042025-08-01T16:06:50.021ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f82a02cf-256d-4933-8d74-d9a0045186ac", "content-length": "26", "date": "Fri, 01 Aug 2025 16:06:49 GMT"} })
75052025-08-01T16:06:50.021ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75062025-08-01T16:06:50.023ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
75072025-08-01T16:06:50.030ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
75082025-08-01T16:06:50.030ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
75092025-08-01T16:06:50.030ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "92eac721-0b88-4aaa-90a2-95a9a8264cf8", "content-length": "372", "date": "Fri, 01 Aug 2025 16:06:49 GMT"} })
75102025-08-01T16:06:50.030ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75112025-08-01T16:06:50.031ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
75122025-08-01T16:06:50.031ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 320.727485ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
75132025-08-01T16:06:50.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75142025-08-01T16:06:50.047ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
75152025-08-01T16:06:50.048ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
75162025-08-01T16:06:50.048ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a2c9e369-5bcb-4f53-b493-28ea686ca360", "date": "Fri, 01 Aug 2025 16:06:49 GMT"} })
75172025-08-01T16:06:50.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75182025-08-01T16:06:50.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75192025-08-01T16:06:50.054ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75202025-08-01T16:06:50.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75212025-08-01T16:06:50.058ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75222025-08-01T16:06:50.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75232025-08-01T16:06:50.062ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
75242025-08-01T16:06:50.062ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
75252025-08-01T16:06:50.062ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1d7d4226-25b3-443b-bc12-340682b42992", "date": "Fri, 01 Aug 2025 16:06:50 GMT"} })
75262025-08-01T16:06:50.064ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 305.295227ms iteration = 19 status = {}
75272025-08-01T16:06:50.087ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
75282025-08-01T16:06:50.087ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
75292025-08-01T16:06:50.087ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b660cc2d-56c0-460f-8011-521f8ac937b7", "content-length": "691", "date": "Fri, 01 Aug 2025 16:06:49 GMT"} })
75302025-08-01T16:06:50.087ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
75312025-08-01T16:06:50.087ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
75322025-08-01T16:06:50.087ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
75332025-08-01T16:06:50.087ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5d859e30-b38c-4425-836d-0832cc09707b", "date": "Fri, 01 Aug 2025 16:06:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
75342025-08-01T16:06:50.087ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
75352025-08-01T16:06:50.090ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 330.7904ms iteration = 19 status = {}
75362025-08-01T16:06:50.090ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "19e7a49f-9327-43a4-9a0d-218d72d5372a", "date": "Fri, 01 Aug 2025 16:06:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
75372025-08-01T16:06:50.090ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
75382025-08-01T16:06:50.092ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "debebd39-3608-456b-a603-0456b2ee40d5", "date": "Fri, 01 Aug 2025 16:06:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
75392025-08-01T16:06:50.092ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
75402025-08-01T16:06:50.094ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
75412025-08-01T16:06:50.094ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 405.830376ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
75422025-08-01T16:06:50.155ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75432025-08-01T16:06:50.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75442025-08-01T16:06:50.157ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 3f21d9d5-3adf-463a-a05d-bc2e2e5d64ca, rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(4c7da70d-ede0-4107-abc5-5650a053be38) } rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
75452025-08-01T16:06:50.157ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75462025-08-01T16:06:50.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75472025-08-01T16:06:50.166ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
75482025-08-01T16:06:50.166ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 4c7da70d-ede0-4107-abc5-5650a053be38
75492025-08-01T16:06:50.166ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
75502025-08-01T16:06:50.166ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
75512025-08-01T16:06:50.166ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75522025-08-01T16:06:50.166ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75532025-08-01T16:06:50.166ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75542025-08-01T16:06:50.166ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
75552025-08-01T16:06:50.166ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75562025-08-01T16:06:50.166ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
75572025-08-01T16:06:50.166ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
75582025-08-01T16:06:50.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75592025-08-01T16:06:50.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75602025-08-01T16:06:50.168ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
75612025-08-01T16:06:50.168ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
75622025-08-01T16:06:50.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a3b39489-ad7e-4ff7-89a3-2574b94f2cd1 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
75632025-08-01T16:06:50.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a3b39489-ad7e-4ff7-89a3-2574b94f2cd1 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
75642025-08-01T16:06:50.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2314 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a3b39489-ad7e-4ff7-89a3-2574b94f2cd1 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
75652025-08-01T16:06:50.281ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a9a30bd3-bfce-4c61-a751-aac5911ff410", "date": "Fri, 01 Aug 2025 16:06:49 GMT"} })
75662025-08-01T16:06:50.281ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch = Switch0
75672025-08-01T16:06:50.281ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
75682025-08-01T16:06:50.288ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b550b96-fa78-4830-a3d6-90716b61ba53", "content-length": "682", "date": "Fri, 01 Aug 2025 16:06:49 GMT"} })
75692025-08-01T16:06:50.288ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75702025-08-01T16:06:50.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75712025-08-01T16:06:50.293ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75722025-08-01T16:06:50.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75732025-08-01T16:06:50.296ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75742025-08-01T16:06:50.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75752025-08-01T16:06:50.298ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75762025-08-01T16:06:50.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75772025-08-01T16:06:50.305ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 546.315005ms iteration = 19 status = {}
75782025-08-01T16:06:51.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = febe6b72-0d03-41a5-b464-73c38617b797 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
75792025-08-01T16:06:51.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = febe6b72-0d03-41a5-b464-73c38617b797 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
75802025-08-01T16:06:51.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2394 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = febe6b72-0d03-41a5-b464-73c38617b797 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
75812025-08-01T16:06:52.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 02ede9fc-8af1-4afe-a24a-9735f2f72efc roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
75822025-08-01T16:06:52.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 02ede9fc-8af1-4afe-a24a-9735f2f72efc resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
75832025-08-01T16:06:52.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3047 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 02ede9fc-8af1-4afe-a24a-9735f2f72efc response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
75842025-08-01T16:06:53.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d7e8bb67-8b18-4350-9ad1-cbb23e94c399 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
75852025-08-01T16:06:53.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d7e8bb67-8b18-4350-9ad1-cbb23e94c399 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
75862025-08-01T16:06:53.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2262 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d7e8bb67-8b18-4350-9ad1-cbb23e94c399 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
75872025-08-01T16:06:54.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cdbb8d47-3ca2-4d64-8493-8ae153a82d77 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
75882025-08-01T16:06:54.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cdbb8d47-3ca2-4d64-8493-8ae153a82d77 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
75892025-08-01T16:06:54.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3036 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cdbb8d47-3ca2-4d64-8493-8ae153a82d77 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
75902025-08-01T16:06:54.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 110 reason = Timeout
75912025-08-01T16:06:54.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
75922025-08-01T16:06:54.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
75932025-08-01T16:06:54.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75942025-08-01T16:06:54.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
75952025-08-01T16:06:54.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
75962025-08-01T16:06:54.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
75972025-08-01T16:06:54.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
75982025-08-01T16:06:54.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.430485ms iteration = 110 status = {"chicken_switches_updated":false}
75992025-08-01T16:06:55.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 62b7cb2b-da50-41ea-a24b-243ea0d9c07f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76002025-08-01T16:06:55.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 62b7cb2b-da50-41ea-a24b-243ea0d9c07f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76012025-08-01T16:06:55.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2207 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 62b7cb2b-da50-41ea-a24b-243ea0d9c07f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76022025-08-01T16:06:56.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f6b4d3f5-c322-400d-9e0f-c531157d4a6a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76032025-08-01T16:06:56.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f6b4d3f5-c322-400d-9e0f-c531157d4a6a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76042025-08-01T16:06:56.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2215 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f6b4d3f5-c322-400d-9e0f-c531157d4a6a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76052025-08-01T16:06:57.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 686e6b4b-e14d-451d-9963-69fb5a635324 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76062025-08-01T16:06:57.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 686e6b4b-e14d-451d-9963-69fb5a635324 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76072025-08-01T16:06:57.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2734 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 686e6b4b-e14d-451d-9963-69fb5a635324 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76082025-08-01T16:06:58.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = aae4b77b-863d-4c41-99f9-1856b2cd0f56 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76092025-08-01T16:06:58.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = aae4b77b-863d-4c41-99f9-1856b2cd0f56 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76102025-08-01T16:06:58.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1803 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = aae4b77b-863d-4c41-99f9-1856b2cd0f56 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76112025-08-01T16:06:59.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 868d93b0-c7a2-46d5-ad47-fcf791dbdaff roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76122025-08-01T16:06:59.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 868d93b0-c7a2-46d5-ad47-fcf791dbdaff resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76132025-08-01T16:06:59.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2702 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 868d93b0-c7a2-46d5-ad47-fcf791dbdaff response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76142025-08-01T16:06:59.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
76152025-08-01T16:06:59.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 111 reason = Timeout
76162025-08-01T16:06:59.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76172025-08-01T16:06:59.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
76182025-08-01T16:06:59.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76192025-08-01T16:06:59.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
76202025-08-01T16:06:59.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
76212025-08-01T16:06:59.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76222025-08-01T16:06:59.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76232025-08-01T16:06:59.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76242025-08-01T16:06:59.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76252025-08-01T16:06:59.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76262025-08-01T16:06:59.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76272025-08-01T16:06:59.762ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.062293ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76282025-08-01T16:06:59.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
76292025-08-01T16:06:59.765ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
76302025-08-01T16:06:59.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
76312025-08-01T16:06:59.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76322025-08-01T16:06:59.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76332025-08-01T16:06:59.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76342025-08-01T16:06:59.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
76352025-08-01T16:06:59.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.050744ms iteration = 111 status = {"chicken_switches_updated":false}
76362025-08-01T16:06:59.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76372025-08-01T16:06:59.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76382025-08-01T16:06:59.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76392025-08-01T16:06:59.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
76402025-08-01T16:06:59.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76412025-08-01T16:06:59.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76422025-08-01T16:06:59.789ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
76432025-08-01T16:06:59.789ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 29.04475ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
76442025-08-01T16:06:59.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 946 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = b3d9d839-fa02-46f5-8312-200655498463 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
76452025-08-01T16:07:00.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7c1e0369-9b59-4fa6-ae7e-f8f9f5b6ef11 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76462025-08-01T16:07:00.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7c1e0369-9b59-4fa6-ae7e-f8f9f5b6ef11 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76472025-08-01T16:07:00.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2150 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7c1e0369-9b59-4fa6-ae7e-f8f9f5b6ef11 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76482025-08-01T16:07:01.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c560ed8e-58bc-4ab8-a436-795bc765fdf0 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76492025-08-01T16:07:01.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c560ed8e-58bc-4ab8-a436-795bc765fdf0 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76502025-08-01T16:07:01.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2424 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c560ed8e-58bc-4ab8-a436-795bc765fdf0 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76512025-08-01T16:07:02.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = db565be3-5129-4d0b-81fc-8efaa24d3b7f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76522025-08-01T16:07:02.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = db565be3-5129-4d0b-81fc-8efaa24d3b7f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76532025-08-01T16:07:02.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2023 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = db565be3-5129-4d0b-81fc-8efaa24d3b7f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76542025-08-01T16:07:03.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9551f8d0-b626-40a0-8fd0-ff79c4e592a6 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76552025-08-01T16:07:03.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9551f8d0-b626-40a0-8fd0-ff79c4e592a6 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76562025-08-01T16:07:03.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2134 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9551f8d0-b626-40a0-8fd0-ff79c4e592a6 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76572025-08-01T16:07:04.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df73d086-f464-4ea0-bed5-cabb4fa68bf2 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76582025-08-01T16:07:04.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df73d086-f464-4ea0-bed5-cabb4fa68bf2 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76592025-08-01T16:07:04.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2334 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df73d086-f464-4ea0-bed5-cabb4fa68bf2 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76602025-08-01T16:07:04.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 112 reason = Timeout
76612025-08-01T16:07:04.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
76622025-08-01T16:07:04.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
76632025-08-01T16:07:04.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76642025-08-01T16:07:04.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
76652025-08-01T16:07:04.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
76662025-08-01T16:07:04.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
76672025-08-01T16:07:04.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
76682025-08-01T16:07:04.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.113885ms iteration = 112 status = {"chicken_switches_updated":false}
76692025-08-01T16:07:05.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 229afea0-f971-49a2-9758-ec58b24b7968 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76702025-08-01T16:07:05.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 229afea0-f971-49a2-9758-ec58b24b7968 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76712025-08-01T16:07:05.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2451 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 229afea0-f971-49a2-9758-ec58b24b7968 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76722025-08-01T16:07:06.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c0144eab-968c-48ee-b9f0-3f1fe439c9ec roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76732025-08-01T16:07:06.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c0144eab-968c-48ee-b9f0-3f1fe439c9ec resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76742025-08-01T16:07:06.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2569 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c0144eab-968c-48ee-b9f0-3f1fe439c9ec response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76752025-08-01T16:07:07.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 27d432a4-d992-49ca-bbe8-72496dd96992 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76762025-08-01T16:07:07.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 27d432a4-d992-49ca-bbe8-72496dd96992 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76772025-08-01T16:07:07.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2219 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 27d432a4-d992-49ca-bbe8-72496dd96992 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76782025-08-01T16:07:08.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9a1613d4-ffbb-4b79-9d3d-f22562200378 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76792025-08-01T16:07:08.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9a1613d4-ffbb-4b79-9d3d-f22562200378 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76802025-08-01T16:07:08.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1741 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9a1613d4-ffbb-4b79-9d3d-f22562200378 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76812025-08-01T16:07:09.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0d64ced3-5da8-425a-80ae-8cd128745135 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76822025-08-01T16:07:09.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0d64ced3-5da8-425a-80ae-8cd128745135 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76832025-08-01T16:07:09.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2458 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0d64ced3-5da8-425a-80ae-8cd128745135 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
76842025-08-01T16:07:09.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
76852025-08-01T16:07:09.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 113 reason = Timeout
76862025-08-01T16:07:09.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76872025-08-01T16:07:09.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
76882025-08-01T16:07:09.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76892025-08-01T16:07:09.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
76902025-08-01T16:07:09.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76912025-08-01T16:07:09.760ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
76922025-08-01T16:07:09.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76932025-08-01T16:07:09.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76942025-08-01T16:07:09.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76952025-08-01T16:07:09.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76962025-08-01T16:07:09.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76972025-08-01T16:07:09.762ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.95407ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76982025-08-01T16:07:09.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
76992025-08-01T16:07:09.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
77002025-08-01T16:07:09.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
77012025-08-01T16:07:09.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77022025-08-01T16:07:09.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77032025-08-01T16:07:09.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77042025-08-01T16:07:09.764ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
77052025-08-01T16:07:09.764ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.548969ms iteration = 113 status = {"chicken_switches_updated":false}
77062025-08-01T16:07:09.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77072025-08-01T16:07:09.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77082025-08-01T16:07:09.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77092025-08-01T16:07:09.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
77102025-08-01T16:07:09.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77112025-08-01T16:07:09.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77122025-08-01T16:07:09.783ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
77132025-08-01T16:07:09.783ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.508133ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
77142025-08-01T16:07:09.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 635 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 1516cac5-3530-407a-b680-83768fadde53 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
77152025-08-01T16:07:10.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0bb135ea-367f-437c-97fa-030630cca73d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77162025-08-01T16:07:10.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0bb135ea-367f-437c-97fa-030630cca73d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77172025-08-01T16:07:10.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1868 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0bb135ea-367f-437c-97fa-030630cca73d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77182025-08-01T16:07:11.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 52edc050-b354-4c2c-9b67-1bc9d3dca872 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77192025-08-01T16:07:11.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 52edc050-b354-4c2c-9b67-1bc9d3dca872 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77202025-08-01T16:07:11.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2391 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 52edc050-b354-4c2c-9b67-1bc9d3dca872 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77212025-08-01T16:07:12.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6b2710e6-58d1-453d-a259-b123f2229a44 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77222025-08-01T16:07:12.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6b2710e6-58d1-453d-a259-b123f2229a44 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77232025-08-01T16:07:12.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1903 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6b2710e6-58d1-453d-a259-b123f2229a44 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77242025-08-01T16:07:13.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fe2a6b8b-885b-4646-80e7-c8c6738e9307 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77252025-08-01T16:07:13.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fe2a6b8b-885b-4646-80e7-c8c6738e9307 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77262025-08-01T16:07:13.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2279 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fe2a6b8b-885b-4646-80e7-c8c6738e9307 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77272025-08-01T16:07:14.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e6e8ea46-7e72-49f2-9ca2-b1fabc38d4e3 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77282025-08-01T16:07:14.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e6e8ea46-7e72-49f2-9ca2-b1fabc38d4e3 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77292025-08-01T16:07:14.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2189 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e6e8ea46-7e72-49f2-9ca2-b1fabc38d4e3 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77302025-08-01T16:07:14.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 114 reason = Timeout
77312025-08-01T16:07:14.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
77322025-08-01T16:07:14.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
77332025-08-01T16:07:14.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77342025-08-01T16:07:14.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
77352025-08-01T16:07:14.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
77362025-08-01T16:07:14.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
77372025-08-01T16:07:14.764ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
77382025-08-01T16:07:14.764ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.26286ms iteration = 114 status = {"chicken_switches_updated":false}
77392025-08-01T16:07:14.913ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::d]:43211
77402025-08-01T16:07:14.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43211 req_id = 85c1c48d-a25b-43d5-9b84-1153540695e9 roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
77412025-08-01T16:07:14.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43211 req_id = 85c1c48d-a25b-43d5-9b84-1153540695e9 resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
77422025-08-01T16:07:14.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3123 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43211 req_id = 85c1c48d-a25b-43d5-9b84-1153540695e9 response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
77432025-08-01T16:07:14.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43211 req_id = c99b87d6-0477-4c4b-974b-6397ba7117c8 roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
77442025-08-01T16:07:14.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43211 req_id = c99b87d6-0477-4c4b-974b-6397ba7117c8 resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
77452025-08-01T16:07:14.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1813 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43211 req_id = c99b87d6-0477-4c4b-974b-6397ba7117c8 response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
77462025-08-01T16:07:15.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a1083440-92e5-4a9a-9c90-7cd83b71279e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77472025-08-01T16:07:15.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a1083440-92e5-4a9a-9c90-7cd83b71279e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77482025-08-01T16:07:15.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2028 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a1083440-92e5-4a9a-9c90-7cd83b71279e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77492025-08-01T16:07:16.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0d38ee7e-f505-4161-ad2d-6be7633e30f8 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77502025-08-01T16:07:16.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0d38ee7e-f505-4161-ad2d-6be7633e30f8 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77512025-08-01T16:07:16.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1890 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0d38ee7e-f505-4161-ad2d-6be7633e30f8 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77522025-08-01T16:07:17.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f0deb54d-5ab9-400e-8f2d-1682ab2d77c8 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77532025-08-01T16:07:17.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f0deb54d-5ab9-400e-8f2d-1682ab2d77c8 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77542025-08-01T16:07:17.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1931 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f0deb54d-5ab9-400e-8f2d-1682ab2d77c8 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77552025-08-01T16:07:18.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0fa808e7-6289-4420-a053-5f04926fe096 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77562025-08-01T16:07:18.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0fa808e7-6289-4420-a053-5f04926fe096 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77572025-08-01T16:07:18.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2427 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0fa808e7-6289-4420-a053-5f04926fe096 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77582025-08-01T16:07:19.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 34f5ad43-ba84-43ae-bcd8-ac52cf065fb8 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77592025-08-01T16:07:19.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 34f5ad43-ba84-43ae-bcd8-ac52cf065fb8 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77602025-08-01T16:07:19.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2160 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 34f5ad43-ba84-43ae-bcd8-ac52cf065fb8 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
77612025-08-01T16:07:19.687ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
77622025-08-01T16:07:19.687ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
77632025-08-01T16:07:19.687ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
77642025-08-01T16:07:19.687ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
77652025-08-01T16:07:19.687ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
77662025-08-01T16:07:19.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
77672025-08-01T16:07:19.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
77682025-08-01T16:07:19.689ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44135, tv_nsec: 706448228 } })
77692025-08-01T16:07:19.690ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
77702025-08-01T16:07:19.690ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.792285ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
77712025-08-01T16:07:19.690ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44135, tv_nsec: 707137909 } })
77722025-08-01T16:07:19.690ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
77732025-08-01T16:07:19.753ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
77742025-08-01T16:07:19.753ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77752025-08-01T16:07:19.754ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "65adc4e8-f21d-4f3d-a6b0-8ac8141973af", "content-length": "26", "date": "Fri, 01 Aug 2025 16:07:19 GMT"} })
77762025-08-01T16:07:19.754ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77772025-08-01T16:07:19.754ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
77782025-08-01T16:07:19.754ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77792025-08-01T16:07:19.754ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77802025-08-01T16:07:19.754ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc4b1f02-4dc0-45af-a2d4-b91e73e7925d", "content-length": "26", "date": "Fri, 01 Aug 2025 16:07:19 GMT"} })
77812025-08-01T16:07:19.754ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77822025-08-01T16:07:19.756ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77832025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 20 reason = Timeout
77842025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
77852025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 16.69\u{b5}s iteration = 20 status = {"disabled":true,"errors":[],"sps":[]}
77862025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
77872025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
77882025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77892025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77902025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
77912025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77922025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77932025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
77942025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77952025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 115 reason = Timeout
77962025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
77972025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
77982025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
77992025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
78002025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
78012025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
78022025-08-01T16:07:19.758ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
78032025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78042025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 20 reason = Timeout
78052025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
78062025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
78072025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
78082025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
78092025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
78102025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78112025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
78122025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
78132025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
78142025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78152025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
78162025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
78172025-08-01T16:07:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78182025-08-01T16:07:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78192025-08-01T16:07:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78202025-08-01T16:07:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
78212025-08-01T16:07:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
78222025-08-01T16:07:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
78232025-08-01T16:07:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78242025-08-01T16:07:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
78252025-08-01T16:07:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78262025-08-01T16:07:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
78272025-08-01T16:07:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78282025-08-01T16:07:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
78292025-08-01T16:07:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78302025-08-01T16:07:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
78312025-08-01T16:07:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78322025-08-01T16:07:19.759ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 20 reason = Timeout
78332025-08-01T16:07:19.759ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
78342025-08-01T16:07:19.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
78352025-08-01T16:07:19.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78362025-08-01T16:07:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78372025-08-01T16:07:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
78382025-08-01T16:07:19.760ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78392025-08-01T16:07:19.760ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78402025-08-01T16:07:19.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78412025-08-01T16:07:19.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78422025-08-01T16:07:19.762ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78432025-08-01T16:07:19.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
78442025-08-01T16:07:19.763ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78452025-08-01T16:07:19.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78462025-08-01T16:07:19.763ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78472025-08-01T16:07:19.764ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6.348443ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
78482025-08-01T16:07:19.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78492025-08-01T16:07:19.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
78502025-08-01T16:07:19.765ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
78512025-08-01T16:07:19.765ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78522025-08-01T16:07:19.766ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78532025-08-01T16:07:19.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78542025-08-01T16:07:19.766ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.942131ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
78552025-08-01T16:07:19.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78562025-08-01T16:07:19.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
78572025-08-01T16:07:19.767ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
78582025-08-01T16:07:19.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
78592025-08-01T16:07:19.768ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78602025-08-01T16:07:19.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
78612025-08-01T16:07:19.768ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
78622025-08-01T16:07:19.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
78632025-08-01T16:07:19.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78642025-08-01T16:07:19.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78652025-08-01T16:07:19.769ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
78662025-08-01T16:07:19.769ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 11.467388ms iteration = 115 status = {"chicken_switches_updated":false}
78672025-08-01T16:07:19.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
78682025-08-01T16:07:19.770ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78692025-08-01T16:07:19.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78702025-08-01T16:07:19.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
78712025-08-01T16:07:19.771ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
78722025-08-01T16:07:19.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
78732025-08-01T16:07:19.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78742025-08-01T16:07:19.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78752025-08-01T16:07:19.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78762025-08-01T16:07:19.772ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78772025-08-01T16:07:19.772ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78782025-08-01T16:07:19.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78792025-08-01T16:07:19.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78802025-08-01T16:07:19.774ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78812025-08-01T16:07:19.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
78822025-08-01T16:07:19.776ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78832025-08-01T16:07:19.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78842025-08-01T16:07:19.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78852025-08-01T16:07:19.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78862025-08-01T16:07:19.791ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78872025-08-01T16:07:19.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78882025-08-01T16:07:19.795ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78892025-08-01T16:07:19.800ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
78902025-08-01T16:07:19.800ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78912025-08-01T16:07:19.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78922025-08-01T16:07:19.803ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78932025-08-01T16:07:19.807ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
78942025-08-01T16:07:19.807ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78952025-08-01T16:07:19.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78962025-08-01T16:07:19.811ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 123.686501ms iteration = 20 status = {}
78972025-08-01T16:07:19.817ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
78982025-08-01T16:07:19.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
78992025-08-01T16:07:19.820ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 133.148487ms iteration = 20 status = null
79002025-08-01T16:07:19.827ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79012025-08-01T16:07:19.827ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
79022025-08-01T16:07:19.827ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79032025-08-01T16:07:19.827ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79042025-08-01T16:07:19.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79052025-08-01T16:07:19.829ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 70.869809ms iteration = 20 status = {"errors":[],"requests_created_ok":[]}
79062025-08-01T16:07:19.829ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79072025-08-01T16:07:19.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79082025-08-01T16:07:19.830ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79092025-08-01T16:07:19.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
79102025-08-01T16:07:19.832ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79112025-08-01T16:07:19.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79122025-08-01T16:07:19.833ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79132025-08-01T16:07:19.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79142025-08-01T16:07:19.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79152025-08-01T16:07:19.834ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 76.102557ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
79162025-08-01T16:07:19.835ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
79172025-08-01T16:07:19.835ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79182025-08-01T16:07:19.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
79192025-08-01T16:07:19.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79202025-08-01T16:07:19.836ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44135, tv_nsec: 853023872 } })
79212025-08-01T16:07:19.836ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
79222025-08-01T16:07:19.838ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 79.702687ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79232025-08-01T16:07:19.838ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79242025-08-01T16:07:19.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
79252025-08-01T16:07:19.841ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
79262025-08-01T16:07:19.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
79272025-08-01T16:07:19.841ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79282025-08-01T16:07:19.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79292025-08-01T16:07:19.844ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:391
79302025-08-01T16:07:19.844ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 84.147521ms iteration = 20 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
79312025-08-01T16:07:19.844ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
79322025-08-01T16:07:19.844ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 85.632747ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
79332025-08-01T16:07:19.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
79342025-08-01T16:07:19.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79352025-08-01T16:07:19.845ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79362025-08-01T16:07:19.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79372025-08-01T16:07:19.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79382025-08-01T16:07:19.853ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 95.026681ms iteration = 22 status = {"physical_disks_added":0}
79392025-08-01T16:07:19.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
79402025-08-01T16:07:19.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79412025-08-01T16:07:19.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79422025-08-01T16:07:19.881ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
79432025-08-01T16:07:19.882ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ed8ed3e-a020-4d61-8aad-8ffd8094d1f1", "content-length": "691", "date": "Fri, 01 Aug 2025 16:07:19 GMT"} })
79442025-08-01T16:07:19.882ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
79452025-08-01T16:07:19.882ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
79462025-08-01T16:07:19.882ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
79472025-08-01T16:07:19.884ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 126.240197ms iteration = 20 status = {}
79482025-08-01T16:07:19.888ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 zone_address = fd00:1122:3344:101::2
79492025-08-01T16:07:19.888ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79502025-08-01T16:07:19.889ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "419b9366-2483-4fa6-b4ba-d5ee978d01c0", "content-length": "26", "date": "Fri, 01 Aug 2025 16:07:19 GMT"} })
79512025-08-01T16:07:19.889ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79522025-08-01T16:07:19.891ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
79532025-08-01T16:07:19.893ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
79542025-08-01T16:07:19.893ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 133.519439ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
79552025-08-01T16:07:19.898ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79562025-08-01T16:07:19.898ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
79572025-08-01T16:07:19.898ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79582025-08-01T16:07:19.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79592025-08-01T16:07:19.902ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 143.739168ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
79602025-08-01T16:07:19.911ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 152.868165ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
79612025-08-01T16:07:19.912ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79622025-08-01T16:07:19.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
79632025-08-01T16:07:19.916ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79642025-08-01T16:07:19.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79652025-08-01T16:07:19.919ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 161.028052ms iteration = 20 status = 0
79662025-08-01T16:07:19.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 611 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = b91c6b75-0b0c-4cbb-a108-d0b29f90b46f response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
79672025-08-01T16:07:19.948ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79682025-08-01T16:07:19.948ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
79692025-08-01T16:07:19.948ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 189.899718ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
79702025-08-01T16:07:20.016ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
79712025-08-01T16:07:20.016ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
79722025-08-01T16:07:20.017ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c246b986-3097-4416-ba98-ab33c97b1847", "content-length": "372", "date": "Fri, 01 Aug 2025 16:07:19 GMT"} })
79732025-08-01T16:07:20.017ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79742025-08-01T16:07:20.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79752025-08-01T16:07:20.048ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79762025-08-01T16:07:20.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79772025-08-01T16:07:20.051ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 3f21d9d5-3adf-463a-a05d-bc2e2e5d64ca, rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(4c7da70d-ede0-4107-abc5-5650a053be38) } rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
79782025-08-01T16:07:20.051ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79792025-08-01T16:07:20.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79802025-08-01T16:07:20.072ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
79812025-08-01T16:07:20.072ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 4c7da70d-ede0-4107-abc5-5650a053be38
79822025-08-01T16:07:20.072ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
79832025-08-01T16:07:20.072ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
79842025-08-01T16:07:20.072ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79852025-08-01T16:07:20.072ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79862025-08-01T16:07:20.072ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79872025-08-01T16:07:20.072ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
79882025-08-01T16:07:20.072ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79892025-08-01T16:07:20.072ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
79902025-08-01T16:07:20.073ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
79912025-08-01T16:07:20.073ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79922025-08-01T16:07:20.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79932025-08-01T16:07:20.076ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
79942025-08-01T16:07:20.076ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
79952025-08-01T16:07:20.089ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
79962025-08-01T16:07:20.089ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
79972025-08-01T16:07:20.089ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d4d7f2bd-e689-4391-a425-64fadddc66c1", "date": "Fri, 01 Aug 2025 16:07:20 GMT"} })
79982025-08-01T16:07:20.089ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79992025-08-01T16:07:20.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80002025-08-01T16:07:20.092ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80012025-08-01T16:07:20.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80022025-08-01T16:07:20.097ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80032025-08-01T16:07:20.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80042025-08-01T16:07:20.101ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
80052025-08-01T16:07:20.101ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80062025-08-01T16:07:20.108ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "280ceecb-3d81-4485-bdc6-5f9522b190e2", "date": "Fri, 01 Aug 2025 16:07:19 GMT"} })
80072025-08-01T16:07:20.110ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 351.517318ms iteration = 20 status = {}
80082025-08-01T16:07:20.195ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "08b1d55b-b97f-4360-9627-06f59bd5aca7", "date": "Fri, 01 Aug 2025 16:07:20 GMT"} })
80092025-08-01T16:07:20.195ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch = Switch0
80102025-08-01T16:07:20.195ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
80112025-08-01T16:07:20.202ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b412d0c6-acf8-465e-b821-cf0e9350e4dc", "content-length": "682", "date": "Fri, 01 Aug 2025 16:07:20 GMT"} })
80122025-08-01T16:07:20.202ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80132025-08-01T16:07:20.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80142025-08-01T16:07:20.206ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80152025-08-01T16:07:20.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80162025-08-01T16:07:20.209ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80172025-08-01T16:07:20.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80182025-08-01T16:07:20.210ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80192025-08-01T16:07:20.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80202025-08-01T16:07:20.218ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 460.124751ms iteration = 20 status = {}
80212025-08-01T16:07:20.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d3472d04-92f3-48b0-82bd-3dd0b27fe578 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80222025-08-01T16:07:20.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d3472d04-92f3-48b0-82bd-3dd0b27fe578 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80232025-08-01T16:07:20.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2615 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d3472d04-92f3-48b0-82bd-3dd0b27fe578 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80242025-08-01T16:07:21.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = aba107c4-9f75-4dd4-8243-b0c0335d7c35 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80252025-08-01T16:07:21.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = aba107c4-9f75-4dd4-8243-b0c0335d7c35 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80262025-08-01T16:07:21.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2541 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = aba107c4-9f75-4dd4-8243-b0c0335d7c35 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80272025-08-01T16:07:22.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ed92e959-0ebc-4c03-9c46-fd5ed87d5f46 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80282025-08-01T16:07:22.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ed92e959-0ebc-4c03-9c46-fd5ed87d5f46 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80292025-08-01T16:07:22.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2333 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ed92e959-0ebc-4c03-9c46-fd5ed87d5f46 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80302025-08-01T16:07:23.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 878b52b9-a31e-4b0c-9cec-536dfcd6a1b9 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80312025-08-01T16:07:23.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 878b52b9-a31e-4b0c-9cec-536dfcd6a1b9 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80322025-08-01T16:07:23.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2275 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 878b52b9-a31e-4b0c-9cec-536dfcd6a1b9 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80332025-08-01T16:07:24.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f8eeb8b1-c02f-4888-ae61-48b30789164e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80342025-08-01T16:07:24.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f8eeb8b1-c02f-4888-ae61-48b30789164e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80352025-08-01T16:07:24.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2166 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f8eeb8b1-c02f-4888-ae61-48b30789164e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80362025-08-01T16:07:24.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 116 reason = Timeout
80372025-08-01T16:07:24.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
80382025-08-01T16:07:24.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
80392025-08-01T16:07:24.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80402025-08-01T16:07:24.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
80412025-08-01T16:07:24.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
80422025-08-01T16:07:24.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
80432025-08-01T16:07:24.764ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
80442025-08-01T16:07:24.764ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.289261ms iteration = 116 status = {"chicken_switches_updated":false}
80452025-08-01T16:07:25.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c243cd11-9bc4-449f-b37e-f98e1ceb2bfe roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80462025-08-01T16:07:25.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c243cd11-9bc4-449f-b37e-f98e1ceb2bfe resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80472025-08-01T16:07:25.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2031 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c243cd11-9bc4-449f-b37e-f98e1ceb2bfe response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80482025-08-01T16:07:26.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 267c992c-cabf-494f-88dd-f9016f50f36d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80492025-08-01T16:07:26.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 267c992c-cabf-494f-88dd-f9016f50f36d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80502025-08-01T16:07:26.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2479 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 267c992c-cabf-494f-88dd-f9016f50f36d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80512025-08-01T16:07:27.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a4640e49-945f-4d54-a65e-d2e56f6fccb9 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80522025-08-01T16:07:27.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a4640e49-945f-4d54-a65e-d2e56f6fccb9 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80532025-08-01T16:07:27.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2067 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a4640e49-945f-4d54-a65e-d2e56f6fccb9 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80542025-08-01T16:07:28.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7f19e1fb-b158-4c0e-8758-2ce242178034 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80552025-08-01T16:07:28.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7f19e1fb-b158-4c0e-8758-2ce242178034 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80562025-08-01T16:07:28.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2047 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7f19e1fb-b158-4c0e-8758-2ce242178034 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80572025-08-01T16:07:29.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
80582025-08-01T16:07:29.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80592025-08-01T16:07:29.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 117 reason = Timeout
80602025-08-01T16:07:29.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
80612025-08-01T16:07:29.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
80622025-08-01T16:07:29.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80632025-08-01T16:07:29.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
80642025-08-01T16:07:29.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80652025-08-01T16:07:29.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80662025-08-01T16:07:29.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80672025-08-01T16:07:29.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80682025-08-01T16:07:29.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80692025-08-01T16:07:29.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80702025-08-01T16:07:29.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
80712025-08-01T16:07:29.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
80722025-08-01T16:07:29.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
80732025-08-01T16:07:29.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80742025-08-01T16:07:29.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80752025-08-01T16:07:29.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80762025-08-01T16:07:29.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
80772025-08-01T16:07:29.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.480197ms iteration = 117 status = {"chicken_switches_updated":false}
80782025-08-01T16:07:29.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80792025-08-01T16:07:29.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80802025-08-01T16:07:29.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80812025-08-01T16:07:29.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
80822025-08-01T16:07:29.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80832025-08-01T16:07:29.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80842025-08-01T16:07:29.785ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
80852025-08-01T16:07:29.785ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.425831ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
80862025-08-01T16:07:29.796ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.780045ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80872025-08-01T16:07:29.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c42224fd-0274-4c81-94f2-cbd684fcf42a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80882025-08-01T16:07:29.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c42224fd-0274-4c81-94f2-cbd684fcf42a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80892025-08-01T16:07:29.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1656 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c42224fd-0274-4c81-94f2-cbd684fcf42a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80902025-08-01T16:07:29.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 576 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 738f7096-1367-4ecc-8376-f00bd773a212 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
80912025-08-01T16:07:30.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 230f6fdd-7b9d-42d4-9ad2-6246f98814cc roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80922025-08-01T16:07:30.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 230f6fdd-7b9d-42d4-9ad2-6246f98814cc resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80932025-08-01T16:07:30.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2151 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 230f6fdd-7b9d-42d4-9ad2-6246f98814cc response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80942025-08-01T16:07:31.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f0f42bc9-822a-4df9-97d5-deeb3d0d7cd3 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80952025-08-01T16:07:31.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f0f42bc9-822a-4df9-97d5-deeb3d0d7cd3 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80962025-08-01T16:07:31.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2404 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f0f42bc9-822a-4df9-97d5-deeb3d0d7cd3 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80972025-08-01T16:07:32.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b405d055-bb1b-4a0e-ad88-fb6a476d6bda roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80982025-08-01T16:07:32.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b405d055-bb1b-4a0e-ad88-fb6a476d6bda resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
80992025-08-01T16:07:32.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2401 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b405d055-bb1b-4a0e-ad88-fb6a476d6bda response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81002025-08-01T16:07:33.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 721cb710-8bef-46c7-9dd4-e6a1ebbc4830 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81012025-08-01T16:07:33.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 721cb710-8bef-46c7-9dd4-e6a1ebbc4830 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81022025-08-01T16:07:33.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2399 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 721cb710-8bef-46c7-9dd4-e6a1ebbc4830 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81032025-08-01T16:07:34.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 118 reason = Timeout
81042025-08-01T16:07:34.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
81052025-08-01T16:07:34.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
81062025-08-01T16:07:34.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81072025-08-01T16:07:34.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
81082025-08-01T16:07:34.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
81092025-08-01T16:07:34.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
81102025-08-01T16:07:34.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
81112025-08-01T16:07:34.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.94498ms iteration = 118 status = {"chicken_switches_updated":false}
81122025-08-01T16:07:34.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4b723d16-2a51-4833-8357-6402b307d529 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81132025-08-01T16:07:34.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4b723d16-2a51-4833-8357-6402b307d529 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81142025-08-01T16:07:34.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2175 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4b723d16-2a51-4833-8357-6402b307d529 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81152025-08-01T16:07:35.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ed1db7d8-0255-4e48-ab2f-0554c736aa47 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81162025-08-01T16:07:35.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ed1db7d8-0255-4e48-ab2f-0554c736aa47 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81172025-08-01T16:07:35.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2310 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ed1db7d8-0255-4e48-ab2f-0554c736aa47 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81182025-08-01T16:07:36.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a9f95e65-f593-48e9-b658-a467563debc0 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81192025-08-01T16:07:36.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a9f95e65-f593-48e9-b658-a467563debc0 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81202025-08-01T16:07:36.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2639 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a9f95e65-f593-48e9-b658-a467563debc0 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81212025-08-01T16:07:37.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 04c752d2-779d-4e20-bb2c-393af43bb5cd roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81222025-08-01T16:07:37.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 04c752d2-779d-4e20-bb2c-393af43bb5cd resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81232025-08-01T16:07:37.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2143 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 04c752d2-779d-4e20-bb2c-393af43bb5cd response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81242025-08-01T16:07:38.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9dd871a4-bb8b-4dbe-a7a6-217fb637e861 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81252025-08-01T16:07:38.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9dd871a4-bb8b-4dbe-a7a6-217fb637e861 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81262025-08-01T16:07:38.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2523 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9dd871a4-bb8b-4dbe-a7a6-217fb637e861 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81272025-08-01T16:07:39.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
81282025-08-01T16:07:39.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 119 reason = Timeout
81292025-08-01T16:07:39.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81302025-08-01T16:07:39.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
81312025-08-01T16:07:39.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81322025-08-01T16:07:39.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
81332025-08-01T16:07:39.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
81342025-08-01T16:07:39.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81352025-08-01T16:07:39.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81362025-08-01T16:07:39.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81372025-08-01T16:07:39.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81382025-08-01T16:07:39.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81392025-08-01T16:07:39.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81402025-08-01T16:07:39.762ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.350522ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81412025-08-01T16:07:39.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
81422025-08-01T16:07:39.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
81432025-08-01T16:07:39.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
81442025-08-01T16:07:39.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81452025-08-01T16:07:39.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81462025-08-01T16:07:39.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81472025-08-01T16:07:39.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
81482025-08-01T16:07:39.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.564479ms iteration = 119 status = {"chicken_switches_updated":false}
81492025-08-01T16:07:39.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81502025-08-01T16:07:39.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81512025-08-01T16:07:39.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81522025-08-01T16:07:39.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
81532025-08-01T16:07:39.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81542025-08-01T16:07:39.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81552025-08-01T16:07:39.785ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
81562025-08-01T16:07:39.785ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.289817ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
81572025-08-01T16:07:39.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 531 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 81dcbc07-84ba-405b-8da9-3a222e6c1be4 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
81582025-08-01T16:07:39.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0da89e9a-5f53-4edf-a8c2-3e3f76b2c799 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81592025-08-01T16:07:39.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0da89e9a-5f53-4edf-a8c2-3e3f76b2c799 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81602025-08-01T16:07:39.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2025 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0da89e9a-5f53-4edf-a8c2-3e3f76b2c799 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81612025-08-01T16:07:40.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 416ea396-f2b9-4f8a-b0ea-8af6951e4ef2 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81622025-08-01T16:07:40.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 416ea396-f2b9-4f8a-b0ea-8af6951e4ef2 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81632025-08-01T16:07:40.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2286 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 416ea396-f2b9-4f8a-b0ea-8af6951e4ef2 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81642025-08-01T16:07:42.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ccef0c70-e3ea-4a50-8859-f4161c907234 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81652025-08-01T16:07:42.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ccef0c70-e3ea-4a50-8859-f4161c907234 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81662025-08-01T16:07:42.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2386 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ccef0c70-e3ea-4a50-8859-f4161c907234 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81672025-08-01T16:07:43.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8737d7bb-859c-41f6-aaed-dc4b66c868ad roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81682025-08-01T16:07:43.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8737d7bb-859c-41f6-aaed-dc4b66c868ad resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81692025-08-01T16:07:43.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2658 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8737d7bb-859c-41f6-aaed-dc4b66c868ad response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81702025-08-01T16:07:44.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8cfb26f9-33e3-49c0-82aa-975fa89db857 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81712025-08-01T16:07:44.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8cfb26f9-33e3-49c0-82aa-975fa89db857 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81722025-08-01T16:07:44.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2256 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8cfb26f9-33e3-49c0-82aa-975fa89db857 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81732025-08-01T16:07:44.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 120 reason = Timeout
81742025-08-01T16:07:44.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
81752025-08-01T16:07:44.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
81762025-08-01T16:07:44.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81772025-08-01T16:07:44.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
81782025-08-01T16:07:44.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
81792025-08-01T16:07:44.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
81802025-08-01T16:07:44.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
81812025-08-01T16:07:44.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.519157ms iteration = 120 status = {"chicken_switches_updated":false}
81822025-08-01T16:07:45.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b2f7a1b5-853a-4888-9b47-ed34b8d82a96 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81832025-08-01T16:07:45.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b2f7a1b5-853a-4888-9b47-ed34b8d82a96 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81842025-08-01T16:07:45.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2199 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b2f7a1b5-853a-4888-9b47-ed34b8d82a96 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81852025-08-01T16:07:46.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5d721466-f539-4436-88a5-1a5a02293cb8 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81862025-08-01T16:07:46.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5d721466-f539-4436-88a5-1a5a02293cb8 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81872025-08-01T16:07:46.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2634 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5d721466-f539-4436-88a5-1a5a02293cb8 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81882025-08-01T16:07:47.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 027e361e-c352-4f91-b184-dcf74e6ce065 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81892025-08-01T16:07:47.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 027e361e-c352-4f91-b184-dcf74e6ce065 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81902025-08-01T16:07:47.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2722 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 027e361e-c352-4f91-b184-dcf74e6ce065 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81912025-08-01T16:07:48.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ea8756c1-14fc-4854-b2d6-bc5ea55927b5 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81922025-08-01T16:07:48.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ea8756c1-14fc-4854-b2d6-bc5ea55927b5 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81932025-08-01T16:07:48.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1872 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ea8756c1-14fc-4854-b2d6-bc5ea55927b5 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81942025-08-01T16:07:49.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d81d08ea-0990-4dbb-b48f-f0231ac09c23 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81952025-08-01T16:07:49.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d81d08ea-0990-4dbb-b48f-f0231ac09c23 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81962025-08-01T16:07:49.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2469 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d81d08ea-0990-4dbb-b48f-f0231ac09c23 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
81972025-08-01T16:07:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
81982025-08-01T16:07:49.687ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
81992025-08-01T16:07:49.687ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
82002025-08-01T16:07:49.687ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-01 15:57:49.687553639 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
82012025-08-01T16:07:49.687ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82022025-08-01T16:07:49.687ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
82032025-08-01T16:07:49.687ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
82042025-08-01T16:07:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
82052025-08-01T16:07:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
82062025-08-01T16:07:49.687ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
82072025-08-01T16:07:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
82082025-08-01T16:07:49.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82092025-08-01T16:07:49.687ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
82102025-08-01T16:07:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
82112025-08-01T16:07:49.687ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
82122025-08-01T16:07:49.687ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
82132025-08-01T16:07:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
82142025-08-01T16:07:49.687ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
82152025-08-01T16:07:49.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82162025-08-01T16:07:49.687ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
82172025-08-01T16:07:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82182025-08-01T16:07:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
82192025-08-01T16:07:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82202025-08-01T16:07:49.688ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cb706a84-a33b-442f-aac2-3a6eb5f3b330.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d688a68d-d771-4ac5-8e66-9efa94dbbea8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d688a68d-d771-4ac5-8e66-9efa94dbbea8.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 44165, tv_nsec: 704824449 } })
82212025-08-01T16:07:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
82222025-08-01T16:07:49.688ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50fe31de-3241-42df-a386-de37ce323a34.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("58598327-8751-423c-a5ac-c610829651e2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 44165, tv_nsec: 704857440 } })
82232025-08-01T16:07:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82242025-08-01T16:07:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
82252025-08-01T16:07:49.688ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
82262025-08-01T16:07:49.688ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.074193ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
82272025-08-01T16:07:49.688ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
82282025-08-01T16:07:49.688ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.104633ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
82292025-08-01T16:07:49.689ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82302025-08-01T16:07:49.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82312025-08-01T16:07:49.690ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82322025-08-01T16:07:49.690ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82332025-08-01T16:07:49.690ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-01 15:57:49.687553639 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
82342025-08-01T16:07:49.690ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.247558ms iteration = 11 status = {"expiration":"2025-08-01T15:57:49.687553639Z","pruned":[]}
82352025-08-01T16:07:49.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82362025-08-01T16:07:49.691ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.255649ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
82372025-08-01T16:07:49.691ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44165, tv_nsec: 708721737 } })
82382025-08-01T16:07:49.692ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
82392025-08-01T16:07:49.692ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44165, tv_nsec: 709224813 } })
82402025-08-01T16:07:49.692ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
82412025-08-01T16:07:49.692ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82422025-08-01T16:07:49.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82432025-08-01T16:07:49.692ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
82442025-08-01T16:07:49.692ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82452025-08-01T16:07:49.693ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82462025-08-01T16:07:49.694ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82472025-08-01T16:07:49.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82482025-08-01T16:07:49.695ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82492025-08-01T16:07:49.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
82502025-08-01T16:07:49.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
82512025-08-01T16:07:49.699ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
82522025-08-01T16:07:49.699ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82532025-08-01T16:07:49.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82542025-08-01T16:07:49.701ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82552025-08-01T16:07:49.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82562025-08-01T16:07:49.703ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82572025-08-01T16:07:49.706ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
82582025-08-01T16:07:49.706ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1
82592025-08-01T16:07:49.706ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 24.76\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1"}
82602025-08-01T16:07:49.706ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
82612025-08-01T16:07:49.706ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82622025-08-01T16:07:49.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82632025-08-01T16:07:49.709ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
82642025-08-01T16:07:49.709ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 5 reason = Timeout
82652025-08-01T16:07:49.709ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 14 reason = Timeout
82662025-08-01T16:07:49.709ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
82672025-08-01T16:07:49.709ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
82682025-08-01T16:07:49.709ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
82692025-08-01T16:07:49.709ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 6.38\u{b5}s iteration = 14 status = "Disabled"
82702025-08-01T16:07:49.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
82712025-08-01T16:07:49.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
82722025-08-01T16:07:49.710ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
82732025-08-01T16:07:49.710ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 3 reason = Timeout
82742025-08-01T16:07:49.710ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 11 reason = Timeout
82752025-08-01T16:07:49.710ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
82762025-08-01T16:07:49.710ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
82772025-08-01T16:07:49.710ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
82782025-08-01T16:07:49.710ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
82792025-08-01T16:07:49.710ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
82802025-08-01T16:07:49.710ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
82812025-08-01T16:07:49.710ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
82822025-08-01T16:07:49.710ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
82832025-08-01T16:07:49.710ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
82842025-08-01T16:07:49.710ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 11 reason = Timeout
82852025-08-01T16:07:49.710ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
82862025-08-01T16:07:49.710ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
82872025-08-01T16:07:49.710ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
82882025-08-01T16:07:49.710ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
82892025-08-01T16:07:49.710ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
82902025-08-01T16:07:49.710ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
82912025-08-01T16:07:49.710ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
82922025-08-01T16:07:49.710ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
82932025-08-01T16:07:49.710ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
82942025-08-01T16:07:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
82952025-08-01T16:07:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
82962025-08-01T16:07:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
82972025-08-01T16:07:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
82982025-08-01T16:07:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
82992025-08-01T16:07:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
83002025-08-01T16:07:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
83012025-08-01T16:07:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
83022025-08-01T16:07:49.711ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83032025-08-01T16:07:49.711ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83042025-08-01T16:07:49.713ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.565328ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
83052025-08-01T16:07:49.713ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
83062025-08-01T16:07:49.713ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 3.589929ms iteration = 11 status = {"by_rx":{},"error":null}
83072025-08-01T16:07:49.714ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
83082025-08-01T16:07:49.714ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
83092025-08-01T16:07:49.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
83102025-08-01T16:07:49.715ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83112025-08-01T16:07:49.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
83122025-08-01T16:07:49.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
83132025-08-01T16:07:49.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83142025-08-01T16:07:49.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
83152025-08-01T16:07:49.717ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
83162025-08-01T16:07:49.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
83172025-08-01T16:07:49.719ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83182025-08-01T16:07:49.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83192025-08-01T16:07:49.719ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
83202025-08-01T16:07:49.719ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
83212025-08-01T16:07:49.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
83222025-08-01T16:07:49.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
83232025-08-01T16:07:49.721ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
83242025-08-01T16:07:49.721ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 11.099947ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
83252025-08-01T16:07:49.721ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83262025-08-01T16:07:49.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83272025-08-01T16:07:49.722ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 12.52959ms iteration = 11 status = {"dispatched":[],"errors":[],"glob_version":"173.0.0","globs_reprocessed":{},"no_receivers":[]}
83282025-08-01T16:07:49.723ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83292025-08-01T16:07:49.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83302025-08-01T16:07:49.725ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83312025-08-01T16:07:49.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83322025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 21 reason = Timeout
83332025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
83342025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
83352025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83362025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 24.94\u{b5}s iteration = 21 status = {"disabled":true,"errors":[],"sps":[]}
83372025-08-01T16:07:49.758ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
83382025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
83392025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83402025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
83412025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83422025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83432025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 121 reason = Timeout
83442025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
83452025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
83462025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
83472025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83482025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83492025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
83502025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
83512025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83522025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
83532025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
83542025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
83552025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 21 reason = Timeout
83562025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
83572025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
83582025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
83592025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83602025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
83612025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83622025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
83632025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83642025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
83652025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83662025-08-01T16:07:49.758ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 21 reason = Timeout
83672025-08-01T16:07:49.759ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
83682025-08-01T16:07:49.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
83692025-08-01T16:07:49.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83702025-08-01T16:07:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83712025-08-01T16:07:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83722025-08-01T16:07:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83732025-08-01T16:07:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83742025-08-01T16:07:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83752025-08-01T16:07:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
83762025-08-01T16:07:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83772025-08-01T16:07:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83782025-08-01T16:07:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
83792025-08-01T16:07:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
83802025-08-01T16:07:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83812025-08-01T16:07:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
83822025-08-01T16:07:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83832025-08-01T16:07:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83842025-08-01T16:07:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83852025-08-01T16:07:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83862025-08-01T16:07:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
83872025-08-01T16:07:49.762ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83882025-08-01T16:07:49.764ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
83892025-08-01T16:07:49.764ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
83902025-08-01T16:07:49.764ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
83912025-08-01T16:07:49.764ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83922025-08-01T16:07:49.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83932025-08-01T16:07:49.766ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
83942025-08-01T16:07:49.766ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83952025-08-01T16:07:49.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83962025-08-01T16:07:49.767ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83972025-08-01T16:07:49.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83982025-08-01T16:07:49.767ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83992025-08-01T16:07:49.767ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
84002025-08-01T16:07:49.767ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84012025-08-01T16:07:49.767ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84022025-08-01T16:07:49.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84032025-08-01T16:07:49.768ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84042025-08-01T16:07:49.769ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.303933ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
84052025-08-01T16:07:49.770ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84062025-08-01T16:07:49.771ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
84072025-08-01T16:07:49.771ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
84082025-08-01T16:07:49.771ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
84092025-08-01T16:07:49.771ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84102025-08-01T16:07:49.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84112025-08-01T16:07:49.771ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84122025-08-01T16:07:49.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84132025-08-01T16:07:49.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84142025-08-01T16:07:49.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84152025-08-01T16:07:49.772ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84162025-08-01T16:07:49.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
84172025-08-01T16:07:49.774ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
84182025-08-01T16:07:49.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
84192025-08-01T16:07:49.775ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84202025-08-01T16:07:49.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
84212025-08-01T16:07:49.775ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
84222025-08-01T16:07:49.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84232025-08-01T16:07:49.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
84242025-08-01T16:07:49.777ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
84252025-08-01T16:07:49.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
84262025-08-01T16:07:49.778ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84272025-08-01T16:07:49.778ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
84282025-08-01T16:07:49.778ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84292025-08-01T16:07:49.778ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
84302025-08-01T16:07:49.778ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
84312025-08-01T16:07:49.778ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 68.414744ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
84322025-08-01T16:07:49.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84332025-08-01T16:07:49.779ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84342025-08-01T16:07:49.779ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84352025-08-01T16:07:49.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84362025-08-01T16:07:49.779ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84372025-08-01T16:07:49.779ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84382025-08-01T16:07:49.780ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84392025-08-01T16:07:49.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84402025-08-01T16:07:49.781ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84412025-08-01T16:07:49.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84422025-08-01T16:07:49.782ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-01T15:57:44.766264Z, time_modified: 2025-08-01T15:57:44.766264Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: eec17da7-eb17-4917-8728-908698b69bbe, db_silo: Silo { identity: SiloIdentity { id: eec17da7-eb17-4917-8728-908698b69bbe, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-01T15:58:34.653875Z, time_modified: 2025-08-01T15:58:34.653875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: eec17da7-eb17-4917-8728-908698b69bbe, db_silo: Silo { identity: SiloIdentity { id: eec17da7-eb17-4917-8728-908698b69bbe, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-01T15:58:34.653875Z, time_modified: 2025-08-01T15:58:34.653875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575" }] }) }
84432025-08-01T16:07:49.782ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 95.375451ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"eec17da7-eb17-4917-8728-908698b69bbe","tls_certs":["b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575"]}},"default_endpoint":{"silo_id":"eec17da7-eb17-4917-8728-908698b69bbe","tls_certs":["b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
84442025-08-01T16:07:49.783ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
84452025-08-01T16:07:49.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
84462025-08-01T16:07:49.785ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
84472025-08-01T16:07:49.785ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84482025-08-01T16:07:49.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84492025-08-01T16:07:49.786ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
84502025-08-01T16:07:49.787ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84512025-08-01T16:07:49.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84522025-08-01T16:07:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84532025-08-01T16:07:49.791ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
84542025-08-01T16:07:49.791ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
84552025-08-01T16:07:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
84562025-08-01T16:07:49.798ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
84572025-08-01T16:07:49.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
84582025-08-01T16:07:49.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
84592025-08-01T16:07:49.802ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
84602025-08-01T16:07:49.802ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 92.601858ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
84612025-08-01T16:07:49.804ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84622025-08-01T16:07:49.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
84632025-08-01T16:07:49.809ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
84642025-08-01T16:07:49.809ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
84652025-08-01T16:07:49.809ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84662025-08-01T16:07:49.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
84672025-08-01T16:07:49.809ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84682025-08-01T16:07:49.811ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
84692025-08-01T16:07:49.811ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6482e44c-c860-4033-b945-5707d343a59d dns_zone_name = oxide.test found_so_far = 0 version = 2
84702025-08-01T16:07:49.811ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84712025-08-01T16:07:49.811ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b3f3e78-a858-43c4-87a5-b8caf45e4477", "content-length": "26", "date": "Fri, 01 Aug 2025 16:07:49 GMT"} })
84722025-08-01T16:07:49.811ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84732025-08-01T16:07:49.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84742025-08-01T16:07:49.813ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
84752025-08-01T16:07:49.814ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84762025-08-01T16:07:49.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84772025-08-01T16:07:49.815ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84782025-08-01T16:07:49.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84792025-08-01T16:07:49.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
84802025-08-01T16:07:49.816ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84812025-08-01T16:07:49.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84822025-08-01T16:07:49.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
84832025-08-01T16:07:49.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84842025-08-01T16:07:49.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84852025-08-01T16:07:49.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
84862025-08-01T16:07:49.820ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84872025-08-01T16:07:49.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84882025-08-01T16:07:49.825ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84892025-08-01T16:07:49.831ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
84902025-08-01T16:07:49.831ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
84912025-08-01T16:07:49.831ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
84922025-08-01T16:07:49.831ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84932025-08-01T16:07:49.831ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84942025-08-01T16:07:49.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
84952025-08-01T16:07:49.831ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2131ea63-7495-47e0-920f-5e99124ab7f5", "content-length": "26", "date": "Fri, 01 Aug 2025 16:07:49 GMT"} })
84962025-08-01T16:07:49.831ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84972025-08-01T16:07:49.833ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
84982025-08-01T16:07:49.833ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84992025-08-01T16:07:49.833ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85002025-08-01T16:07:49.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85012025-08-01T16:07:49.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85022025-08-01T16:07:49.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85032025-08-01T16:07:49.834ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 76.233191ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
85042025-08-01T16:07:49.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
85052025-08-01T16:07:49.837ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85062025-08-01T16:07:49.837ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85072025-08-01T16:07:49.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85082025-08-01T16:07:49.838ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6482e44c-c860-4033-b945-5707d343a59d dns_zone_name = oxide.test found_so_far = 4 version = 2
85092025-08-01T16:07:49.838ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
85102025-08-01T16:07:49.838ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-01 15:58:34.713515 UTC dns_group = external generation = 2
85112025-08-01T16:07:49.838ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 150.540845ms iteration = 11 status = {"generation":2}
85122025-08-01T16:07:49.838ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
85132025-08-01T16:07:49.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
85142025-08-01T16:07:49.838ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
85152025-08-01T16:07:49.838ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
85162025-08-01T16:07:49.838ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 128.573009ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
85172025-08-01T16:07:49.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
85182025-08-01T16:07:49.839ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85192025-08-01T16:07:49.840ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85202025-08-01T16:07:49.840ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85212025-08-01T16:07:49.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85222025-08-01T16:07:49.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85232025-08-01T16:07:49.842ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85242025-08-01T16:07:49.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
85252025-08-01T16:07:49.845ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
85262025-08-01T16:07:49.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
85272025-08-01T16:07:49.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
85282025-08-01T16:07:49.845ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85292025-08-01T16:07:49.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85302025-08-01T16:07:49.846ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
85312025-08-01T16:07:49.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
85322025-08-01T16:07:49.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
85332025-08-01T16:07:49.847ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85342025-08-01T16:07:49.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
85352025-08-01T16:07:49.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85362025-08-01T16:07:49.848ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
85372025-08-01T16:07:49.848ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 89.523264ms iteration = 121 status = {"chicken_switches_updated":false}
85382025-08-01T16:07:49.849ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85392025-08-01T16:07:49.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
85402025-08-01T16:07:49.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
85412025-08-01T16:07:49.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85422025-08-01T16:07:49.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
85432025-08-01T16:07:49.850ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85442025-08-01T16:07:49.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85452025-08-01T16:07:49.857ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 98.771804ms iteration = 21 status = {"errors":[],"requests_created_ok":[]}
85462025-08-01T16:07:49.857ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
85472025-08-01T16:07:49.857ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 99.053764ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
85482025-08-01T16:07:49.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
85492025-08-01T16:07:49.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85502025-08-01T16:07:49.858ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44165, tv_nsec: 874900796 } })
85512025-08-01T16:07:49.858ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
85522025-08-01T16:07:49.859ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85532025-08-01T16:07:49.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85542025-08-01T16:07:49.861ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
85552025-08-01T16:07:49.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
85562025-08-01T16:07:49.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
85572025-08-01T16:07:49.863ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85582025-08-01T16:07:49.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85592025-08-01T16:07:49.866ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85602025-08-01T16:07:49.866ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
85612025-08-01T16:07:49.866ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 107.740847ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
85622025-08-01T16:07:49.869ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85632025-08-01T16:07:49.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85642025-08-01T16:07:49.871ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85652025-08-01T16:07:49.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85662025-08-01T16:07:49.872ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
85672025-08-01T16:07:49.872ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 113.299355ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
85682025-08-01T16:07:49.873ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85692025-08-01T16:07:49.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85702025-08-01T16:07:49.876ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85712025-08-01T16:07:49.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85722025-08-01T16:07:49.878ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85732025-08-01T16:07:49.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
85742025-08-01T16:07:49.884ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85752025-08-01T16:07:49.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85762025-08-01T16:07:49.886ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85772025-08-01T16:07:49.886ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85782025-08-01T16:07:49.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85792025-08-01T16:07:49.888ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
85802025-08-01T16:07:49.888ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 129.472236ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
85812025-08-01T16:07:49.889ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85822025-08-01T16:07:49.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85832025-08-01T16:07:49.889ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85842025-08-01T16:07:49.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85852025-08-01T16:07:49.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85862025-08-01T16:07:49.892ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:391
85872025-08-01T16:07:49.892ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 133.696204ms iteration = 21 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
85882025-08-01T16:07:49.892ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85892025-08-01T16:07:49.893ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85902025-08-01T16:07:49.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85912025-08-01T16:07:49.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85922025-08-01T16:07:49.895ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 137.446448ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
85932025-08-01T16:07:49.896ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85942025-08-01T16:07:49.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85952025-08-01T16:07:49.898ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85962025-08-01T16:07:49.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85972025-08-01T16:07:49.901ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85982025-08-01T16:07:49.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85992025-08-01T16:07:49.905ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86002025-08-01T16:07:49.908ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 149.477563ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86012025-08-01T16:07:49.908ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
86022025-08-01T16:07:49.908ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 02fcb774-aa43-4052-9996-b85e2d1358b5 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
86032025-08-01T16:07:49.908ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86042025-08-01T16:07:49.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86052025-08-01T16:07:49.910ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(f0017b14-2cda-4fce-b031-dbd3d93f630a, 0), (9afe3868-8402-4f17-8ee5-4b095a8da767, 0), (35b490cb-703f-4148-b034-9706bbcc0602, 0)]
86062025-08-01T16:07:49.910ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86072025-08-01T16:07:49.910ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44165, tv_nsec: 927706547 } })
86082025-08-01T16:07:49.912ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
86092025-08-01T16:07:49.912ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86102025-08-01T16:07:49.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86112025-08-01T16:07:49.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
86122025-08-01T16:07:49.917ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86132025-08-01T16:07:49.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86142025-08-01T16:07:49.918ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86152025-08-01T16:07:49.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86162025-08-01T16:07:49.920ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86172025-08-01T16:07:49.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86182025-08-01T16:07:49.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 864 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 4eb2bca0-6e6a-47dc-8b45-39c0b2f83904 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
86192025-08-01T16:07:49.922ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86202025-08-01T16:07:49.926ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 02fcb774-aa43-4052-9996-b85e2d1358b5 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
86212025-08-01T16:07:49.926ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
86222025-08-01T16:07:49.926ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-01 15:58:34.032744 UTC dns_group = internal generation = 1
86232025-08-01T16:07:49.926ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 238.520322ms iteration = 11 status = {"generation":1}
86242025-08-01T16:07:49.926ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 167.425487ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
86252025-08-01T16:07:49.930ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
86262025-08-01T16:07:49.930ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86272025-08-01T16:07:49.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86282025-08-01T16:07:49.931ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86292025-08-01T16:07:49.934ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
86302025-08-01T16:07:49.934ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
86312025-08-01T16:07:49.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
86322025-08-01T16:07:49.936ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86332025-08-01T16:07:49.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86342025-08-01T16:07:49.937ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86352025-08-01T16:07:49.937ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
86362025-08-01T16:07:49.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86372025-08-01T16:07:49.937ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 228.619712ms iteration = 5 status = {"blueprint_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","inventory_collection_id":"35b490cb-703f-4148-b034-9706bbcc0602","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
86382025-08-01T16:07:49.939ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86392025-08-01T16:07:49.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86402025-08-01T16:07:49.941ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86412025-08-01T16:07:49.941ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
86422025-08-01T16:07:49.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86432025-08-01T16:07:49.942ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "63d46c11-5850-4955-af6b-8a74e72d259c", "date": "Fri, 01 Aug 2025 16:07:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
86442025-08-01T16:07:49.942ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
86452025-08-01T16:07:49.943ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86462025-08-01T16:07:49.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86472025-08-01T16:07:49.944ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86482025-08-01T16:07:49.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86492025-08-01T16:07:49.945ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "bc50a42e-8def-4e77-9607-8a63acdecb80", "date": "Fri, 01 Aug 2025 16:07:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
86502025-08-01T16:07:49.945ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
86512025-08-01T16:07:49.945ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86522025-08-01T16:07:49.945ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86532025-08-01T16:07:49.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86542025-08-01T16:07:49.947ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
86552025-08-01T16:07:49.947ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 260.19891ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
86562025-08-01T16:07:49.947ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86572025-08-01T16:07:49.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86582025-08-01T16:07:49.949ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
86592025-08-01T16:07:49.949ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86602025-08-01T16:07:49.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86612025-08-01T16:07:49.949ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86622025-08-01T16:07:49.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86632025-08-01T16:07:49.950ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
86642025-08-01T16:07:49.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
86652025-08-01T16:07:49.951ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86662025-08-01T16:07:49.951ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 193.365473ms iteration = 21 status = 0
86672025-08-01T16:07:49.952ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 265.070237ms iteration = 21 status = null
86682025-08-01T16:07:49.956ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
86692025-08-01T16:07:49.956ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86702025-08-01T16:07:49.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86712025-08-01T16:07:49.958ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86722025-08-01T16:07:49.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86732025-08-01T16:07:49.960ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86742025-08-01T16:07:49.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86752025-08-01T16:07:49.961ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86762025-08-01T16:07:49.962ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 203.988015ms iteration = 23 status = {"physical_disks_added":0}
86772025-08-01T16:07:49.966ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
86782025-08-01T16:07:49.966ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86792025-08-01T16:07:49.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86802025-08-01T16:07:49.981ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 674b1238-f8d3-485d-ac9a-18ae283a4c3f, kind: Service { id: d688a68d-d771-4ac5-8e66-9efa94dbbea8 }, name: Name("external-dns-d688a68d-d771-4ac5-8e66-9efa94dbbea8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 26])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 71946e26-41e0-47b5-a3f1-1dc1f88d6f19, kind: Service { id: cb706a84-a33b-442f-aac2-3a6eb5f3b330 }, name: Name("external-dns-cb706a84-a33b-442f-aac2-3a6eb5f3b330"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 140])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 04b363be-ccb0-479c-9061-146e0f3cd0f5, kind: Service { id: 47e81fb5-17f5-43c3-b06b-bf529b9c19c7 }, name: Name("nexus-47e81fb5-17f5-43c3-b06b-bf529b9c19c7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1a7b404e-03d2-462c-b83f-716d429c5ce6, kind: Service { id: 7248190d-c184-423c-8431-31fe40a79e2e }, name: Name("nexus-7248190d-c184-423c-8431-31fe40a79e2e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d893583b-243d-4d0f-855b-7369e8e9fbf2, kind: Service { id: 8dfddf96-9f2d-4f96-9bf8-8181bf947a28 }, name: Name("nexus-8dfddf96-9f2d-4f96-9bf8-8181bf947a28"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 228])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
86812025-08-01T16:07:49.981ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86822025-08-01T16:07:49.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86832025-08-01T16:07:49.984ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86842025-08-01T16:07:49.985ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86852025-08-01T16:07:49.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86862025-08-01T16:07:49.987ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
86872025-08-01T16:07:49.987ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86882025-08-01T16:07:49.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86892025-08-01T16:07:49.989ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
86902025-08-01T16:07:49.989ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 674b1238-f8d3-485d-ac9a-18ae283a4c3f, kind: Service { id: d688a68d-d771-4ac5-8e66-9efa94dbbea8 }, name: Name("external-dns-d688a68d-d771-4ac5-8e66-9efa94dbbea8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 26])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 71946e26-41e0-47b5-a3f1-1dc1f88d6f19, kind: Service { id: cb706a84-a33b-442f-aac2-3a6eb5f3b330 }, name: Name("external-dns-cb706a84-a33b-442f-aac2-3a6eb5f3b330"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 140])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 04b363be-ccb0-479c-9061-146e0f3cd0f5, kind: Service { id: 47e81fb5-17f5-43c3-b06b-bf529b9c19c7 }, name: Name("nexus-47e81fb5-17f5-43c3-b06b-bf529b9c19c7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1a7b404e-03d2-462c-b83f-716d429c5ce6, kind: Service { id: 7248190d-c184-423c-8431-31fe40a79e2e }, name: Name("nexus-7248190d-c184-423c-8431-31fe40a79e2e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d893583b-243d-4d0f-855b-7369e8e9fbf2, kind: Service { id: 8dfddf96-9f2d-4f96-9bf8-8181bf947a28 }, name: Name("nexus-8dfddf96-9f2d-4f96-9bf8-8181bf947a28"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 228])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 674b1238-f8d3-485d-ac9a-18ae283a4c3f, kind: Service { id: d688a68d-d771-4ac5-8e66-9efa94dbbea8 }, name: Name("external-dns-d688a68d-d771-4ac5-8e66-9efa94dbbea8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 26])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 71946e26-41e0-47b5-a3f1-1dc1f88d6f19, kind: Service { id: cb706a84-a33b-442f-aac2-3a6eb5f3b330 }, name: Name("external-dns-cb706a84-a33b-442f-aac2-3a6eb5f3b330"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 140])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 3, code: Some(IcmpParamRange { first: 3, last: 4 }) })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 5, code: None })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 11, code: None }))]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 04b363be-ccb0-479c-9061-146e0f3cd0f5, kind: Service { id: 47e81fb5-17f5-43c3-b06b-bf529b9c19c7 }, name: Name("nexus-47e81fb5-17f5-43c3-b06b-bf529b9c19c7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1a7b404e-03d2-462c-b83f-716d429c5ce6, kind: Service { id: 7248190d-c184-423c-8431-31fe40a79e2e }, name: Name("nexus-7248190d-c184-423c-8431-31fe40a79e2e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d893583b-243d-4d0f-855b-7369e8e9fbf2, kind: Service { id: 8dfddf96-9f2d-4f96-9bf8-8181bf947a28 }, name: Name("nexus-8dfddf96-9f2d-4f96-9bf8-8181bf947a28"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 228])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }]
86912025-08-01T16:07:49.989ZDEBGnexus (service-firewall-rule-progator): resolved 3 rules for sleds background_task = service_firewall_rule_propagation
86922025-08-01T16:07:49.995ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86932025-08-01T16:07:49.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86942025-08-01T16:07:50.000ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86952025-08-01T16:07:50.002ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
86962025-08-01T16:07:50.002ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86972025-08-01T16:07:50.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86982025-08-01T16:07:50.005ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86992025-08-01T16:07:50.008ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
87002025-08-01T16:07:50.008ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87012025-08-01T16:07:50.008ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
87022025-08-01T16:07:50.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87032025-08-01T16:07:50.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
87042025-08-01T16:07:50.010ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87052025-08-01T16:07:50.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
87062025-08-01T16:07:50.012ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
87072025-08-01T16:07:50.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
87082025-08-01T16:07:50.014ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
87092025-08-01T16:07:50.014ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
87102025-08-01T16:07:50.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
87112025-08-01T16:07:50.016ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87122025-08-01T16:07:50.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
87132025-08-01T16:07:50.018ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
87142025-08-01T16:07:50.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
87152025-08-01T16:07:50.020ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = tuf_artifact_replication body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/artifacts-config
87162025-08-01T16:07:50.021ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts-config", status: 204, headers: {"x-request-id": "f2c83e8d-d6cb-4c99-b672-08038da16bf1", "date": "Fri, 01 Aug 2025 16:07:49 GMT"} })
87172025-08-01T16:07:50.021ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
87182025-08-01T16:07:50.021ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb462b57-a8b9-42d7-b987-5480ee215b27", "content-length": "26", "date": "Fri, 01 Aug 2025 16:07:49 GMT"} })
87192025-08-01T16:07:50.021ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:672 sled = http://[fd00:1122:3344:101::1]:12345
87202025-08-01T16:07:50.024ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 314.173706ms iteration = 3 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":2,"put_config_err":0,"put_config_ok":2,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"generation":1,"operation":"put_config","target_sled":"c9f3bda2-4996-4bda-a233-772410078d0a","time":"2025-08-01T16:02:49.952832654Z"},{"operation":"list","target_sled":"c9f3bda2-4996-4bda-a233-772410078d0a","time":"2025-08-01T16:02:49.953808154Z"},{"generation":1,"operation":"put_config","target_sled":"c9f3bda2-4996-4bda-a233-772410078d0a","time":"2025-08-01T16:07:50.021207096Z"},{"operation":"list","target_sled":"c9f3bda2-4996-4bda-a233-772410078d0a","time":"2025-08-01T16:07:50.021494925Z"}]}
87212025-08-01T16:07:50.037ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 349.484176ms iteration = 21 status = {}
87222025-08-01T16:07:50.065ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: c9f3bda2-4996-4bda-a233-772410078d0a, time_created: 2025-08-01T15:58:33.455031Z, time_modified: 2025-08-01T15:58:33.455031Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(56094621696)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
87232025-08-01T16:07:50.065ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
87242025-08-01T16:07:50.130ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
87252025-08-01T16:07:50.130ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
87262025-08-01T16:07:50.131ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a21a0341-8dd2-4e21-8ddd-c4932171d0b0", "content-length": "372", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
87272025-08-01T16:07:50.131ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87282025-08-01T16:07:50.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87292025-08-01T16:07:50.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0af7bddf-15bb-4472-98a3-db0746fa6a70 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
87302025-08-01T16:07:50.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0af7bddf-15bb-4472-98a3-db0746fa6a70 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
87312025-08-01T16:07:50.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1872 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0af7bddf-15bb-4472-98a3-db0746fa6a70 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
87322025-08-01T16:07:50.146ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
87332025-08-01T16:07:50.146ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
87342025-08-01T16:07:50.147ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bafe14d8-fd1e-4ae3-9ceb-dccbcc19d866", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
87352025-08-01T16:07:50.147ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87362025-08-01T16:07:50.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87372025-08-01T16:07:50.149ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87382025-08-01T16:07:50.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87392025-08-01T16:07:50.152ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87402025-08-01T16:07:50.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87412025-08-01T16:07:50.156ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("05555c13-4c05-42fd-92b3-e3c44b62b2b9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("19edd33b-6858-4b8b-9e63-892731ad9dfb.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("8cb84b4c-7eab-4e52-98ad-8d9d52f086c6.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("bce58ae3-29a9-4fa6-b00e-fde799629ccc.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("e0deb6c5-fb93-42a5-bd1c-fe423a6f2686.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("e0deb6c5-fb93-42a5-bd1c-fe423a6f2686.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::6)) }], valid_until: Instant { tv_sec: 44166, tv_nsec: 172837280 } })
87422025-08-01T16:07:50.156ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
87432025-08-01T16:07:50.156ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
87442025-08-01T16:07:50.156ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "69622a38-03b7-4819-bf4f-fa6b9659e544", "date": "Fri, 01 Aug 2025 16:07:49 GMT"} })
87452025-08-01T16:07:50.156ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
87462025-08-01T16:07:50.156ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
87472025-08-01T16:07:50.156ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
87482025-08-01T16:07:50.157ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9622cba-3181-4b15-bc44-c553e2015fff", "content-length": "476", "date": "Fri, 01 Aug 2025 16:07:49 GMT"} })
87492025-08-01T16:07:50.157ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
87502025-08-01T16:07:50.157ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 zone_address = fd00:1122:3344:101::2
87512025-08-01T16:07:50.157ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
87522025-08-01T16:07:50.157ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d26bd2a3-0c38-452a-a8ce-f58547544397", "content-length": "26", "date": "Fri, 01 Aug 2025 16:07:49 GMT"} })
87532025-08-01T16:07:50.157ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
87542025-08-01T16:07:50.157ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3aef1a40-22f2-43b2-b686-629814bbc8fc", "content-length": "734", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
87552025-08-01T16:07:50.157ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
87562025-08-01T16:07:50.158ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "87aefbb7-e6e9-418b-a08c-4d583656a45c", "content-length": "111", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
87572025-08-01T16:07:50.158ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
87582025-08-01T16:07:50.158ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf0ee703-3750-49cc-9965-a79ab66cc125", "content-length": "111", "date": "Fri, 01 Aug 2025 16:07:49 GMT"} })
87592025-08-01T16:07:50.158ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
87602025-08-01T16:07:50.158ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9abd05aa-f5bb-41c3-9c25-c3de56b2d5ec", "content-length": "170", "date": "Fri, 01 Aug 2025 16:07:49 GMT"} })
87612025-08-01T16:07:50.159ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
87622025-08-01T16:07:50.159ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
87632025-08-01T16:07:50.159ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1e3f45c-b0c1-4540-b20b-f43749ef9668", "content-length": "170", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
87642025-08-01T16:07:50.159ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
87652025-08-01T16:07:50.159ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c482171e-8f28-4a85-8b7c-7924b500493b", "content-length": "691", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
87662025-08-01T16:07:50.159ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
87672025-08-01T16:07:50.159ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
87682025-08-01T16:07:50.159ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
87692025-08-01T16:07:50.159ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "935c687b-035b-422c-ada1-4ce8eb600779", "content-length": "179", "date": "Fri, 01 Aug 2025 16:07:49 GMT"} })
87702025-08-01T16:07:50.159ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
87712025-08-01T16:07:50.160ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4c66ac3-4b1c-4991-b55f-fcc24f5a1d6a", "content-length": "179", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
87722025-08-01T16:07:50.160ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
87732025-08-01T16:07:50.160ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "52679bd8-0774-4711-84e2-77ff2fd6824a", "content-length": "702", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
87742025-08-01T16:07:50.160ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
87752025-08-01T16:07:50.160ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f40076d5-9b2a-462f-8ab4-549c452938ef", "content-length": "727", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
87762025-08-01T16:07:50.160ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
87772025-08-01T16:07:50.160ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "eed6b841-9683-4c53-ac6c-7519559bb50c", "content-length": "729", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
87782025-08-01T16:07:50.160ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
87792025-08-01T16:07:50.160ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1326e1a6-3337-491a-ba1d-a8726bea8d9a", "content-length": "728", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
87802025-08-01T16:07:50.160ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
87812025-08-01T16:07:50.161ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2ec4b17-b5f3-41bb-86e7-205bfc32795d", "content-length": "722", "date": "Fri, 01 Aug 2025 16:07:49 GMT"} })
87822025-08-01T16:07:50.161ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/0
87832025-08-01T16:07:50.161ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0c75b67-825f-46c9-95f3-7b6f95d472de", "content-length": "144", "date": "Fri, 01 Aug 2025 16:07:49 GMT"} })
87842025-08-01T16:07:50.161ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/1
87852025-08-01T16:07:50.161ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "daf29701-3447-49c7-a4db-c9c4e5b206a1", "content-length": "147", "date": "Fri, 01 Aug 2025 16:07:49 GMT"} })
87862025-08-01T16:07:50.161ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
87872025-08-01T16:07:50.161ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e0f38c3-fdda-4c57-b37e-c3a8ba38bca8", "content-length": "109", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
87882025-08-01T16:07:50.161ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
87892025-08-01T16:07:50.161ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
87902025-08-01T16:07:50.162ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "42634fe9-8fbf-4d91-b958-3112efc50ea0", "content-length": "109", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
87912025-08-01T16:07:50.162ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
87922025-08-01T16:07:50.162ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d63a0c0a-46b7-47d7-b169-88b06cd2b496", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
87932025-08-01T16:07:50.162ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
87942025-08-01T16:07:50.162ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 403.772723ms iteration = 21 status = {}
87952025-08-01T16:07:50.162ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee6d5a91-fca9-45e5-bb47-d0f6213cd195", "content-length": "169", "date": "Fri, 01 Aug 2025 16:07:49 GMT"} })
87962025-08-01T16:07:50.162ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
87972025-08-01T16:07:50.162ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9e9e739-20bd-444d-85a6-985b7d778e57", "content-length": "169", "date": "Fri, 01 Aug 2025 16:07:49 GMT"} })
87982025-08-01T16:07:50.162ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
87992025-08-01T16:07:50.163ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "78aabce1-5b6d-4216-ad2f-a65e1e95ad52", "content-length": "178", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
88002025-08-01T16:07:50.163ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
88012025-08-01T16:07:50.163ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb1fa951-ad56-44f7-91d1-6e6156d4b340", "content-length": "178", "date": "Fri, 01 Aug 2025 16:07:49 GMT"} })
88022025-08-01T16:07:50.163ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
88032025-08-01T16:07:50.163ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
88042025-08-01T16:07:50.163ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "70b2c88f-fe01-416c-b987-90a2b0012da1", "content-length": "702", "date": "Fri, 01 Aug 2025 16:07:49 GMT"} })
88052025-08-01T16:07:50.163ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
88062025-08-01T16:07:50.163ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6f6526d-9b29-43c5-810d-bf1a9b748568", "content-length": "727", "date": "Fri, 01 Aug 2025 16:07:49 GMT"} })
88072025-08-01T16:07:50.163ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
88082025-08-01T16:07:50.164ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d79ed64-3c48-4d7e-bcc1-2b50d15fad87", "content-length": "729", "date": "Fri, 01 Aug 2025 16:07:49 GMT"} })
88092025-08-01T16:07:50.164ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
88102025-08-01T16:07:50.164ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8dd213f-e113-4fc5-841a-dc0608e164f1", "content-length": "728", "date": "Fri, 01 Aug 2025 16:07:49 GMT"} })
88112025-08-01T16:07:50.164ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
88122025-08-01T16:07:50.164ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 405.770204ms iteration = 21 status = {}
88132025-08-01T16:07:50.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
88142025-08-01T16:07:50.165ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a7b9d79f-3061-4e34-b0b1-87b0b91d8db6", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
88152025-08-01T16:07:50.165ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
88162025-08-01T16:07:50.166ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88172025-08-01T16:07:50.167ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "103866a7-b4a4-4541-adc9-477565073d77", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
88182025-08-01T16:07:50.167ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
88192025-08-01T16:07:50.168ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
88202025-08-01T16:07:50.169ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
88212025-08-01T16:07:50.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
88222025-08-01T16:07:50.169ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
88232025-08-01T16:07:50.169ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 481.586032ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
88242025-08-01T16:07:50.170ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88252025-08-01T16:07:50.172ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
88262025-08-01T16:07:50.172ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
88272025-08-01T16:07:50.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
88282025-08-01T16:07:50.191ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
88292025-08-01T16:07:50.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
88302025-08-01T16:07:50.194ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
88312025-08-01T16:07:50.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
88322025-08-01T16:07:50.195ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88332025-08-01T16:07:50.198ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
88342025-08-01T16:07:50.198ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
88352025-08-01T16:07:50.199ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "a4478875-5ad8-4649-b46c-fc8f8bb2983f", "date": "Fri, 01 Aug 2025 16:07:49 GMT"} })
88362025-08-01T16:07:50.201ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:491
88372025-08-01T16:07:50.201ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 491.029938ms
88382025-08-01T16:07:50.201ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 491.037338ms iteration = 3 status = {}
88392025-08-01T16:07:50.242ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
88402025-08-01T16:07:50.242ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
88412025-08-01T16:07:50.290ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4834aa9-011d-4b8d-beb4-75ef1742d7b7", "content-length": "88477", "date": "Fri, 01 Aug 2025 16:07:49 GMT"} })
88422025-08-01T16:07:50.292ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
88432025-08-01T16:07:50.292ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
88442025-08-01T16:07:50.292ZDEBGnexus (BackgroundTasks): begin collection from CockroachDB nodes background_task = inventory_collection
88452025-08-01T16:07:50.292ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
88462025-08-01T16:07:50.292ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
88472025-08-01T16:07:50.292ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
88482025-08-01T16:07:50.292ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
88492025-08-01T16:07:50.292ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
88502025-08-01T16:07:50.292ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d17ae717-6a8c-4ebd-a073-83cb1f591ad1", "content-length": "64", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
88512025-08-01T16:07:50.292ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ca1f59e-9630-4cda-a1dd-4e3aef9022f2", "content-length": "64", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
88522025-08-01T16:07:50.292ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/proxy/status/vars
88532025-08-01T16:07:50.292ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/proxy/status/vars
88542025-08-01T16:07:50.292ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ccdfb42-0957-435a-96c9-0980d35b01d4", "content-length": "64", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
88552025-08-01T16:07:50.292ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "92918662-9096-4cb1-a0a5-90cdf5d9d731", "content-length": "64", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
88562025-08-01T16:07:50.292ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/proxy/status/vars
88572025-08-01T16:07:50.292ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/proxy/status/vars
88582025-08-01T16:07:50.292ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "74286ba7-a469-40bd-8880-9a9bff1820a1", "content-length": "64", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
88592025-08-01T16:07:50.292ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/proxy/status/vars
88602025-08-01T16:07:50.305ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88612025-08-01T16:07:50.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88622025-08-01T16:07:50.308ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 3f21d9d5-3adf-463a-a05d-bc2e2e5d64ca, rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(4c7da70d-ede0-4107-abc5-5650a053be38) } rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
88632025-08-01T16:07:50.308ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88642025-08-01T16:07:50.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88652025-08-01T16:07:50.318ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
88662025-08-01T16:07:50.318ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 4c7da70d-ede0-4107-abc5-5650a053be38
88672025-08-01T16:07:50.318ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
88682025-08-01T16:07:50.318ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
88692025-08-01T16:07:50.318ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88702025-08-01T16:07:50.318ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88712025-08-01T16:07:50.318ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88722025-08-01T16:07:50.318ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
88732025-08-01T16:07:50.318ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88742025-08-01T16:07:50.318ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
88752025-08-01T16:07:50.318ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
88762025-08-01T16:07:50.318ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88772025-08-01T16:07:50.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88782025-08-01T16:07:50.322ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
88792025-08-01T16:07:50.322ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
88802025-08-01T16:07:50.340ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "74f301e1-0c12-41bd-9cf2-43f404925b11", "content-length": "399163", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
88812025-08-01T16:07:50.341ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c73b99e-379f-4527-92c4-55ff207c3a1e", "content-length": "423941", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
88822025-08-01T16:07:50.343ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "acf9cc3b-e5da-4eab-bd48-389620663039", "content-length": "389058", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
88832025-08-01T16:07:50.344ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "5fa1ced2-55ee-4b4b-8ac4-ec4c67b24a49", "content-length": "394543", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
88842025-08-01T16:07:50.345ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "896522d6-f92b-4007-bc29-ce4949806e70", "content-length": "396216", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
88852025-08-01T16:07:50.348ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 2
88862025-08-01T16:07:50.348ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 1
88872025-08-01T16:07:50.348ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 3
88882025-08-01T16:07:50.348ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 5
88892025-08-01T16:07:50.348ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 4
88902025-08-01T16:07:50.379ZDEBGnexus (BackgroundTasks): begin collection from NTP admin (timesync) background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1b]:10123 zone_id = d7da687a-b979-4eb1-af39-563fc74e2ce0 (service)
88912025-08-01T16:07:50.379ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None method = GET ntp_admin_url = http://[fd00:1122:3344:101::1b]:10123 uri = http://[fd00:1122:3344:101::1b]:10123/timesync
88922025-08-01T16:07:50.385ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection ntp_admin_url = http://[fd00:1122:3344:101::1b]:10123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1b]:10123/timesync", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e60efd5-c7bd-451b-a498-13889506794c", "content-length": "124", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
88932025-08-01T16:07:50.387ZDEBGnexus (BackgroundTasks): begin collection from internal DNS servers background_task = inventory_collection
88942025-08-01T16:07:50.445ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4699d444-af1b-4dfa-b7a6-6d07658ce185", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
88952025-08-01T16:07:50.445ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch = Switch0
88962025-08-01T16:07:50.445ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
88972025-08-01T16:07:50.446ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "87805fa1-0f8e-4150-92f2-07c72712982e", "content-length": "682", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
88982025-08-01T16:07:50.446ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88992025-08-01T16:07:50.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89002025-08-01T16:07:50.450ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89012025-08-01T16:07:50.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89022025-08-01T16:07:50.453ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89032025-08-01T16:07:50.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89042025-08-01T16:07:50.455ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89052025-08-01T16:07:50.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89062025-08-01T16:07:50.462ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 704.301955ms iteration = 21 status = {}
89072025-08-01T16:07:50.484ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = 50fe31de-3241-42df-a386-de37ce323a34 (service)
89082025-08-01T16:07:50.484ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:3::1]:5353 method = GET uri = http://[fd00:1122:3344:3::1]:5353/config
89092025-08-01T16:07:50.485ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:3::1]:5353 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "23bc8796-6dee-4f60-9700-4dc39803a4be", "content-length": "9110", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
89102025-08-01T16:07:50.485ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = 50fe31de-3241-42df-a386-de37ce323a34 (service)
89112025-08-01T16:07:50.487ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = 58598327-8751-423c-a5ac-c610829651e2 (service)
89122025-08-01T16:07:50.487ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:2::1]:5353 method = GET uri = http://[fd00:1122:3344:2::1]:5353/config
89132025-08-01T16:07:50.487ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:2::1]:5353 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "64b4ff7b-4231-45ce-98cf-2ef7bd0ccb06", "content-length": "9110", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
89142025-08-01T16:07:50.487ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = 58598327-8751-423c-a5ac-c610829651e2 (service)
89152025-08-01T16:07:50.489ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0 (service)
89162025-08-01T16:07:50.489ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:1::1]:5353 method = GET uri = http://[fd00:1122:3344:1::1]:5353/config
89172025-08-01T16:07:50.490ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:1::1]:5353 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9033a693-8743-4e0c-bcf1-66bc21681e90", "content-length": "9110", "date": "Fri, 01 Aug 2025 16:07:50 GMT"} })
89182025-08-01T16:07:50.490ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0 (service)
89192025-08-01T16:07:50.492ZDEBGnexus (BackgroundTasks): finished collection from internal DNS servers background_task = inventory_collection
89202025-08-01T16:07:50.492ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
89212025-08-01T16:07:50.494ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
89222025-08-01T16:07:50.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
89232025-08-01T16:07:50.496ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89242025-08-01T16:07:50.498ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
89252025-08-01T16:07:50.498ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
89262025-08-01T16:07:50.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
89272025-08-01T16:07:50.706ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 16b55235-93b8-4dbb-85b4-bdc092ce83e0 file = nexus/db-queries/src/db/datastore/inventory.rs:1551
89282025-08-01T16:07:50.706ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 16b55235-93b8-4dbb-85b4-bdc092ce83e0 time_started = 2025-08-01 16:07:50.156726 UTC
89292025-08-01T16:07:50.706ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 6 reason = Dependency
89302025-08-01T16:07:50.706ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 15 reason = Dependency
89312025-08-01T16:07:50.706ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
89322025-08-01T16:07:50.706ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 8.9\u{b5}s iteration = 15 status = "Disabled"
89332025-08-01T16:07:50.706ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
89342025-08-01T16:07:50.706ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
89352025-08-01T16:07:50.706ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89362025-08-01T16:07:50.706ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 996.955439ms iteration = 3 status = {"collection_id":"16b55235-93b8-4dbb-85b4-bdc092ce83e0","time_done":"2025-08-01 16:07:50.492650 UTC","time_started":"2025-08-01 16:07:50.156726 UTC"}
89372025-08-01T16:07:50.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
89382025-08-01T16:07:50.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89392025-08-01T16:07:50.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89402025-08-01T16:07:50.708ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89412025-08-01T16:07:50.710ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89422025-08-01T16:07:50.710ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89432025-08-01T16:07:50.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89442025-08-01T16:07:50.711ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
89452025-08-01T16:07:50.711ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
89462025-08-01T16:07:50.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
89472025-08-01T16:07:50.713ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89482025-08-01T16:07:50.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89492025-08-01T16:07:50.714ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89502025-08-01T16:07:50.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89512025-08-01T16:07:50.716ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89522025-08-01T16:07:50.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89532025-08-01T16:07:50.742ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 36.524547ms iteration = 24 status = {"physical_disks_added":0}
89542025-08-01T16:07:50.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
89552025-08-01T16:07:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
89562025-08-01T16:07:50.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
89572025-08-01T16:07:50.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
89582025-08-01T16:07:50.917ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89592025-08-01T16:07:50.920ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
89602025-08-01T16:07:50.920ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
89612025-08-01T16:07:50.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
89622025-08-01T16:07:50.922ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89632025-08-01T16:07:50.927ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
89642025-08-01T16:07:50.927ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
89652025-08-01T16:07:50.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
89662025-08-01T16:07:50.929ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
89672025-08-01T16:07:50.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
89682025-08-01T16:07:50.932ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89692025-08-01T16:07:50.936ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
89702025-08-01T16:07:50.936ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
89712025-08-01T16:07:50.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
89722025-08-01T16:07:50.938ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89732025-08-01T16:07:50.940ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
89742025-08-01T16:07:50.940ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
89752025-08-01T16:07:50.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
89762025-08-01T16:07:50.943ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
89772025-08-01T16:07:50.943ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 237.394798ms iteration = 6 status = {"blueprint_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","inventory_collection_id":"81414019-a696-4ccd-9bfb-33404dd8ab37","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
89782025-08-01T16:07:51.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b1d43f4e-d7aa-4b7e-a72f-79e760981e42 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
89792025-08-01T16:07:51.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b1d43f4e-d7aa-4b7e-a72f-79e760981e42 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
89802025-08-01T16:07:51.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2582 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b1d43f4e-d7aa-4b7e-a72f-79e760981e42 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
89812025-08-01T16:07:52.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e37092f7-411f-4a6d-8064-bfb1e0692f2d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
89822025-08-01T16:07:52.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e37092f7-411f-4a6d-8064-bfb1e0692f2d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
89832025-08-01T16:07:52.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3009 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e37092f7-411f-4a6d-8064-bfb1e0692f2d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
89842025-08-01T16:07:53.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2ad0244c-f269-4345-a533-4c2d5aff0511 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
89852025-08-01T16:07:53.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2ad0244c-f269-4345-a533-4c2d5aff0511 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
89862025-08-01T16:07:53.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2840 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2ad0244c-f269-4345-a533-4c2d5aff0511 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
89872025-08-01T16:07:54.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 23845c11-0aa0-438e-9228-7bee40df4257 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
89882025-08-01T16:07:54.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 23845c11-0aa0-438e-9228-7bee40df4257 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
89892025-08-01T16:07:54.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2364 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 23845c11-0aa0-438e-9228-7bee40df4257 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
89902025-08-01T16:07:54.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 122 reason = Timeout
89912025-08-01T16:07:54.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
89922025-08-01T16:07:54.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
89932025-08-01T16:07:54.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89942025-08-01T16:07:54.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
89952025-08-01T16:07:54.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
89962025-08-01T16:07:54.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
89972025-08-01T16:07:54.764ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
89982025-08-01T16:07:54.764ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.613301ms iteration = 122 status = {"chicken_switches_updated":false}
89992025-08-01T16:07:55.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 37844a5b-cabb-4d4c-85e1-84ebe06475bd roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90002025-08-01T16:07:55.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 37844a5b-cabb-4d4c-85e1-84ebe06475bd resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90012025-08-01T16:07:55.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2285 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 37844a5b-cabb-4d4c-85e1-84ebe06475bd response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90022025-08-01T16:07:56.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 96a1360e-04a4-4b18-ab3f-27ec5b6a79f2 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90032025-08-01T16:07:56.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 96a1360e-04a4-4b18-ab3f-27ec5b6a79f2 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90042025-08-01T16:07:56.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1910 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 96a1360e-04a4-4b18-ab3f-27ec5b6a79f2 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90052025-08-01T16:07:57.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b61b1ddf-c58f-43ad-b1bf-f53932e4fab2 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90062025-08-01T16:07:57.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b61b1ddf-c58f-43ad-b1bf-f53932e4fab2 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90072025-08-01T16:07:57.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2368 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b61b1ddf-c58f-43ad-b1bf-f53932e4fab2 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90082025-08-01T16:07:58.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dba7b7c6-3374-4d29-8f98-493f36b8805b roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90092025-08-01T16:07:58.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dba7b7c6-3374-4d29-8f98-493f36b8805b resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90102025-08-01T16:07:58.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2255 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dba7b7c6-3374-4d29-8f98-493f36b8805b response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90112025-08-01T16:07:59.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = afd9545e-10fd-4c9d-ab4a-12d14bf9c2eb roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90122025-08-01T16:07:59.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = afd9545e-10fd-4c9d-ab4a-12d14bf9c2eb resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90132025-08-01T16:07:59.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2367 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = afd9545e-10fd-4c9d-ab4a-12d14bf9c2eb response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90142025-08-01T16:07:59.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
90152025-08-01T16:07:59.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 123 reason = Timeout
90162025-08-01T16:07:59.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90172025-08-01T16:07:59.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
90182025-08-01T16:07:59.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
90192025-08-01T16:07:59.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90202025-08-01T16:07:59.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
90212025-08-01T16:07:59.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90222025-08-01T16:07:59.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90232025-08-01T16:07:59.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90242025-08-01T16:07:59.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90252025-08-01T16:07:59.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90262025-08-01T16:07:59.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90272025-08-01T16:07:59.763ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.753615ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90282025-08-01T16:07:59.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
90292025-08-01T16:07:59.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
90302025-08-01T16:07:59.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
90312025-08-01T16:07:59.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90322025-08-01T16:07:59.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90332025-08-01T16:07:59.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90342025-08-01T16:07:59.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
90352025-08-01T16:07:59.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.524548ms iteration = 123 status = {"chicken_switches_updated":false}
90362025-08-01T16:07:59.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90372025-08-01T16:07:59.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90382025-08-01T16:07:59.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90392025-08-01T16:07:59.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
90402025-08-01T16:07:59.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90412025-08-01T16:07:59.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90422025-08-01T16:07:59.784ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
90432025-08-01T16:07:59.784ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.789621ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
90442025-08-01T16:07:59.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 591 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 293d0bdb-2c1f-48df-b175-33b5c1221c6d response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
90452025-08-01T16:08:00.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f69d8c5f-428e-4de1-87c3-fba2fed9b41f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90462025-08-01T16:08:00.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f69d8c5f-428e-4de1-87c3-fba2fed9b41f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90472025-08-01T16:08:00.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1744 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f69d8c5f-428e-4de1-87c3-fba2fed9b41f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90482025-08-01T16:08:01.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2098515a-55a9-4d40-89d2-3c128311a094 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90492025-08-01T16:08:01.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2098515a-55a9-4d40-89d2-3c128311a094 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90502025-08-01T16:08:01.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2219 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2098515a-55a9-4d40-89d2-3c128311a094 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90512025-08-01T16:08:02.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 741c00c4-8a15-47f8-9e57-082f4f0309b4 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90522025-08-01T16:08:02.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 741c00c4-8a15-47f8-9e57-082f4f0309b4 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90532025-08-01T16:08:02.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2493 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 741c00c4-8a15-47f8-9e57-082f4f0309b4 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90542025-08-01T16:08:03.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cbb31bdc-6142-48f9-b5f6-96c600188e1b roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90552025-08-01T16:08:03.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cbb31bdc-6142-48f9-b5f6-96c600188e1b resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90562025-08-01T16:08:03.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2197 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cbb31bdc-6142-48f9-b5f6-96c600188e1b response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90572025-08-01T16:08:04.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2c709dd9-9fc4-4f6b-a8fc-5c7253de9347 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90582025-08-01T16:08:04.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2c709dd9-9fc4-4f6b-a8fc-5c7253de9347 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90592025-08-01T16:08:04.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2711 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2c709dd9-9fc4-4f6b-a8fc-5c7253de9347 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90602025-08-01T16:08:04.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 124 reason = Timeout
90612025-08-01T16:08:04.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
90622025-08-01T16:08:04.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
90632025-08-01T16:08:04.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90642025-08-01T16:08:04.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
90652025-08-01T16:08:04.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
90662025-08-01T16:08:04.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
90672025-08-01T16:08:04.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
90682025-08-01T16:08:04.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.619061ms iteration = 124 status = {"chicken_switches_updated":false}
90692025-08-01T16:08:05.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9187b7c4-5c59-4ff3-bfd6-dcc4bd9abad1 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90702025-08-01T16:08:05.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9187b7c4-5c59-4ff3-bfd6-dcc4bd9abad1 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90712025-08-01T16:08:05.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2113 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9187b7c4-5c59-4ff3-bfd6-dcc4bd9abad1 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90722025-08-01T16:08:06.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f5e66172-5b2b-48a5-bf02-291bb53879b2 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90732025-08-01T16:08:06.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f5e66172-5b2b-48a5-bf02-291bb53879b2 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90742025-08-01T16:08:06.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2519 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f5e66172-5b2b-48a5-bf02-291bb53879b2 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90752025-08-01T16:08:07.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bc842c48-755f-44cb-9ffa-6893c9115714 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90762025-08-01T16:08:07.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bc842c48-755f-44cb-9ffa-6893c9115714 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90772025-08-01T16:08:07.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2666 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bc842c48-755f-44cb-9ffa-6893c9115714 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90782025-08-01T16:08:08.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 27409bd2-a5ac-4adb-bde3-97b1eb2372b5 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90792025-08-01T16:08:08.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 27409bd2-a5ac-4adb-bde3-97b1eb2372b5 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90802025-08-01T16:08:08.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2069 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 27409bd2-a5ac-4adb-bde3-97b1eb2372b5 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90812025-08-01T16:08:09.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 72f904a7-ba36-4aef-9e61-717666670b55 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90822025-08-01T16:08:09.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 72f904a7-ba36-4aef-9e61-717666670b55 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90832025-08-01T16:08:09.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2071 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 72f904a7-ba36-4aef-9e61-717666670b55 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
90842025-08-01T16:08:09.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
90852025-08-01T16:08:09.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90862025-08-01T16:08:09.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 125 reason = Timeout
90872025-08-01T16:08:09.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
90882025-08-01T16:08:09.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90892025-08-01T16:08:09.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
90902025-08-01T16:08:09.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
90912025-08-01T16:08:09.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90922025-08-01T16:08:09.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90932025-08-01T16:08:09.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90942025-08-01T16:08:09.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90952025-08-01T16:08:09.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90962025-08-01T16:08:09.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90972025-08-01T16:08:09.762ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.350412ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90982025-08-01T16:08:09.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
90992025-08-01T16:08:09.765ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
91002025-08-01T16:08:09.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
91012025-08-01T16:08:09.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91022025-08-01T16:08:09.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91032025-08-01T16:08:09.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91042025-08-01T16:08:09.767ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
91052025-08-01T16:08:09.767ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.830057ms iteration = 125 status = {"chicken_switches_updated":false}
91062025-08-01T16:08:09.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91072025-08-01T16:08:09.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91082025-08-01T16:08:09.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91092025-08-01T16:08:09.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
91102025-08-01T16:08:09.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91112025-08-01T16:08:09.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91122025-08-01T16:08:09.785ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
91132025-08-01T16:08:09.785ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.880775ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
91142025-08-01T16:08:09.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 689 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = a0715162-d5e2-4774-8730-f1828f97cb60 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
91152025-08-01T16:08:10.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fa625020-baa3-4a66-8990-95e8c85e02d3 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91162025-08-01T16:08:10.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fa625020-baa3-4a66-8990-95e8c85e02d3 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91172025-08-01T16:08:10.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2294 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fa625020-baa3-4a66-8990-95e8c85e02d3 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91182025-08-01T16:08:11.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b63b8276-e85b-4afc-b1df-6dce02bc5990 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91192025-08-01T16:08:11.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b63b8276-e85b-4afc-b1df-6dce02bc5990 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91202025-08-01T16:08:11.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2276 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b63b8276-e85b-4afc-b1df-6dce02bc5990 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91212025-08-01T16:08:12.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dcaefb99-6415-4f8a-b61a-4b87be43052e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91222025-08-01T16:08:12.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dcaefb99-6415-4f8a-b61a-4b87be43052e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91232025-08-01T16:08:12.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2688 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dcaefb99-6415-4f8a-b61a-4b87be43052e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91242025-08-01T16:08:13.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 762456e6-4a38-4118-87cc-333ca116ad59 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91252025-08-01T16:08:13.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 762456e6-4a38-4118-87cc-333ca116ad59 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91262025-08-01T16:08:13.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2079 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 762456e6-4a38-4118-87cc-333ca116ad59 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91272025-08-01T16:08:14.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 93219e0f-9e28-4520-aa33-61f6ebdef4f0 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91282025-08-01T16:08:14.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 93219e0f-9e28-4520-aa33-61f6ebdef4f0 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91292025-08-01T16:08:14.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2424 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 93219e0f-9e28-4520-aa33-61f6ebdef4f0 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91302025-08-01T16:08:14.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 126 reason = Timeout
91312025-08-01T16:08:14.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
91322025-08-01T16:08:14.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
91332025-08-01T16:08:14.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91342025-08-01T16:08:14.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
91352025-08-01T16:08:14.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
91362025-08-01T16:08:14.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
91372025-08-01T16:08:14.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
91382025-08-01T16:08:14.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.688633ms iteration = 126 status = {"chicken_switches_updated":false}
91392025-08-01T16:08:15.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7ec3a5b6-2fcb-439d-9de6-1a11908dcfd9 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91402025-08-01T16:08:15.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7ec3a5b6-2fcb-439d-9de6-1a11908dcfd9 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91412025-08-01T16:08:15.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2882 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7ec3a5b6-2fcb-439d-9de6-1a11908dcfd9 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91422025-08-01T16:08:16.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ee6cdeb6-2295-41d3-9108-6716c1139ec1 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91432025-08-01T16:08:16.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ee6cdeb6-2295-41d3-9108-6716c1139ec1 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91442025-08-01T16:08:16.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2248 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ee6cdeb6-2295-41d3-9108-6716c1139ec1 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91452025-08-01T16:08:17.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 329d9c7f-8d17-41fc-8aa5-af66163b64f3 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91462025-08-01T16:08:17.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 329d9c7f-8d17-41fc-8aa5-af66163b64f3 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91472025-08-01T16:08:17.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2723 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 329d9c7f-8d17-41fc-8aa5-af66163b64f3 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91482025-08-01T16:08:18.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 580edb6c-0c0f-4728-b1b2-e0fd8f2ee5ce roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91492025-08-01T16:08:18.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 580edb6c-0c0f-4728-b1b2-e0fd8f2ee5ce resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91502025-08-01T16:08:18.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1814 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 580edb6c-0c0f-4728-b1b2-e0fd8f2ee5ce response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91512025-08-01T16:08:19.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2b79e150-4b2b-447c-acf8-55c601e70da9 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91522025-08-01T16:08:19.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2b79e150-4b2b-447c-acf8-55c601e70da9 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91532025-08-01T16:08:19.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2330 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2b79e150-4b2b-447c-acf8-55c601e70da9 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
91542025-08-01T16:08:19.687ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
91552025-08-01T16:08:19.687ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
91562025-08-01T16:08:19.687ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
91572025-08-01T16:08:19.687ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
91582025-08-01T16:08:19.687ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
91592025-08-01T16:08:19.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
91602025-08-01T16:08:19.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
91612025-08-01T16:08:19.689ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44195, tv_nsec: 705872824 } })
91622025-08-01T16:08:19.689ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
91632025-08-01T16:08:19.690ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.882427ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
91642025-08-01T16:08:19.690ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44195, tv_nsec: 706706859 } })
91652025-08-01T16:08:19.690ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
91662025-08-01T16:08:19.749ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
91672025-08-01T16:08:19.749ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
91682025-08-01T16:08:19.750ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5631cc4-20d9-429b-bb1d-e46988b19145", "content-length": "26", "date": "Fri, 01 Aug 2025 16:08:19 GMT"} })
91692025-08-01T16:08:19.750ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91702025-08-01T16:08:19.750ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
91712025-08-01T16:08:19.754ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
91722025-08-01T16:08:19.754ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
91732025-08-01T16:08:19.754ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a83d4883-6f01-468a-92a4-b6f3fa49f423", "content-length": "26", "date": "Fri, 01 Aug 2025 16:08:19 GMT"} })
91742025-08-01T16:08:19.754ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91752025-08-01T16:08:19.757ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
91762025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 22 reason = Timeout
91772025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
91782025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 13.881\u{b5}s iteration = 22 status = {"disabled":true,"errors":[],"sps":[]}
91792025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
91802025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
91812025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
91822025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
91832025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91842025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91852025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91862025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 127 reason = Timeout
91872025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
91882025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
91892025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
91902025-08-01T16:08:19.758ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
91912025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91922025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91932025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
91942025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91952025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
91962025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
91972025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
91982025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
91992025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
92002025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92012025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
92022025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
92032025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 22 reason = Timeout
92042025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
92052025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
92062025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
92072025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92082025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
92092025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
92102025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
92112025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92122025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92132025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92142025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92152025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
92162025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92172025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92182025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92192025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
92202025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92212025-08-01T16:08:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92222025-08-01T16:08:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
92232025-08-01T16:08:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
92242025-08-01T16:08:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92252025-08-01T16:08:19.759ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 22 reason = Timeout
92262025-08-01T16:08:19.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
92272025-08-01T16:08:19.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92282025-08-01T16:08:19.759ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
92292025-08-01T16:08:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92302025-08-01T16:08:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
92312025-08-01T16:08:19.760ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92322025-08-01T16:08:19.762ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92332025-08-01T16:08:19.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92342025-08-01T16:08:19.763ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92352025-08-01T16:08:19.763ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92362025-08-01T16:08:19.764ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92372025-08-01T16:08:19.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92382025-08-01T16:08:19.764ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92392025-08-01T16:08:19.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
92402025-08-01T16:08:19.764ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92412025-08-01T16:08:19.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92422025-08-01T16:08:19.765ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.406405ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
92432025-08-01T16:08:19.766ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.683833ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
92442025-08-01T16:08:19.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92452025-08-01T16:08:19.767ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
92462025-08-01T16:08:19.767ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92472025-08-01T16:08:19.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
92482025-08-01T16:08:19.767ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92492025-08-01T16:08:19.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92502025-08-01T16:08:19.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92512025-08-01T16:08:19.768ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92522025-08-01T16:08:19.768ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 9.865439ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
92532025-08-01T16:08:19.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
92542025-08-01T16:08:19.768ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92552025-08-01T16:08:19.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92562025-08-01T16:08:19.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
92572025-08-01T16:08:19.768ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
92582025-08-01T16:08:19.768ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 10.445787ms iteration = 22 status = {"errors":[],"requests_created_ok":[]}
92592025-08-01T16:08:19.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
92602025-08-01T16:08:19.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
92612025-08-01T16:08:19.769ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92622025-08-01T16:08:19.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92632025-08-01T16:08:19.769ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92642025-08-01T16:08:19.770ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44195, tv_nsec: 786530079 } })
92652025-08-01T16:08:19.770ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92662025-08-01T16:08:19.770ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
92672025-08-01T16:08:19.770ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 11.996444ms iteration = 127 status = {"chicken_switches_updated":false}
92682025-08-01T16:08:19.770ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
92692025-08-01T16:08:19.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
92702025-08-01T16:08:19.770ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
92712025-08-01T16:08:19.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92722025-08-01T16:08:19.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
92732025-08-01T16:08:19.770ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92742025-08-01T16:08:19.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92752025-08-01T16:08:19.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92762025-08-01T16:08:19.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92772025-08-01T16:08:19.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92782025-08-01T16:08:19.772ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
92792025-08-01T16:08:19.772ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92802025-08-01T16:08:19.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92812025-08-01T16:08:19.773ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92822025-08-01T16:08:19.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92832025-08-01T16:08:19.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92842025-08-01T16:08:19.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92852025-08-01T16:08:19.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
92862025-08-01T16:08:19.775ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92872025-08-01T16:08:19.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92882025-08-01T16:08:19.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
92892025-08-01T16:08:19.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92902025-08-01T16:08:19.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92912025-08-01T16:08:19.800ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
92922025-08-01T16:08:19.800ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 40.402785ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
92932025-08-01T16:08:19.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92942025-08-01T16:08:19.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92952025-08-01T16:08:19.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92962025-08-01T16:08:19.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92972025-08-01T16:08:19.807ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92982025-08-01T16:08:19.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92992025-08-01T16:08:19.809ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93002025-08-01T16:08:19.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93012025-08-01T16:08:19.809ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93022025-08-01T16:08:19.811ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 52.885394ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
93032025-08-01T16:08:19.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
93042025-08-01T16:08:19.812ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93052025-08-01T16:08:19.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93062025-08-01T16:08:19.814ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93072025-08-01T16:08:19.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93082025-08-01T16:08:19.815ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 56.643127ms iteration = 22 status = 0
93092025-08-01T16:08:19.816ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93102025-08-01T16:08:19.816ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93112025-08-01T16:08:19.816ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
93122025-08-01T16:08:19.816ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93132025-08-01T16:08:19.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93142025-08-01T16:08:19.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93152025-08-01T16:08:19.818ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93162025-08-01T16:08:19.818ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
93172025-08-01T16:08:19.818ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93182025-08-01T16:08:19.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93192025-08-01T16:08:19.819ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
93202025-08-01T16:08:19.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
93212025-08-01T16:08:19.820ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
93222025-08-01T16:08:19.821ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 62.591747ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
93232025-08-01T16:08:19.824ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93242025-08-01T16:08:19.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
93252025-08-01T16:08:19.829ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
93262025-08-01T16:08:19.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
93272025-08-01T16:08:19.859ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
93282025-08-01T16:08:19.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
93292025-08-01T16:08:19.862ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 175.636536ms iteration = 22 status = null
93302025-08-01T16:08:19.872ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 113.867732ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
93312025-08-01T16:08:19.875ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93322025-08-01T16:08:19.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93332025-08-01T16:08:19.884ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 zone_address = fd00:1122:3344:101::2
93342025-08-01T16:08:19.884ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93352025-08-01T16:08:19.884ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "00850f75-72f3-449e-bc0a-e91b08ffdbf3", "content-length": "26", "date": "Fri, 01 Aug 2025 16:08:19 GMT"} })
93362025-08-01T16:08:19.884ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93372025-08-01T16:08:19.886ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
93382025-08-01T16:08:19.888ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:391
93392025-08-01T16:08:19.888ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 128.892138ms iteration = 22 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
93402025-08-01T16:08:19.891ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93412025-08-01T16:08:19.891ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
93422025-08-01T16:08:19.891ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 133.146997ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
93432025-08-01T16:08:19.900ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 141.746618ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
93442025-08-01T16:08:19.924ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 995 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 6549c7a7-5a98-4986-9a56-59c4d083b6e9 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
93452025-08-01T16:08:19.942ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 183.841364ms iteration = 25 status = {"physical_disks_added":0}
93462025-08-01T16:08:19.991ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 303.709939ms iteration = 22 status = {}
93472025-08-01T16:08:20.013ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93482025-08-01T16:08:20.013ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
93492025-08-01T16:08:20.014ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93502025-08-01T16:08:20.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93512025-08-01T16:08:20.014ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "69e8b815-f708-4b77-b423-16dfe4d18280", "content-length": "372", "date": "Fri, 01 Aug 2025 16:08:19 GMT"} })
93522025-08-01T16:08:20.014ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93532025-08-01T16:08:20.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93542025-08-01T16:08:20.015ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93552025-08-01T16:08:20.017ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
93562025-08-01T16:08:20.017ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93572025-08-01T16:08:20.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93582025-08-01T16:08:20.019ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93592025-08-01T16:08:20.021ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
93602025-08-01T16:08:20.021ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93612025-08-01T16:08:20.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93622025-08-01T16:08:20.029ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
93632025-08-01T16:08:20.029ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
93642025-08-01T16:08:20.029ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0b80a676-caf2-47d2-b1b2-8ae53ffce035", "date": "Fri, 01 Aug 2025 16:08:20 GMT"} })
93652025-08-01T16:08:20.029ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93662025-08-01T16:08:20.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93672025-08-01T16:08:20.032ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93682025-08-01T16:08:20.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93692025-08-01T16:08:20.034ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93702025-08-01T16:08:20.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93712025-08-01T16:08:20.037ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
93722025-08-01T16:08:20.037ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93732025-08-01T16:08:20.044ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9db9809a-f4ab-40ac-9952-94d5bb8908f6", "date": "Fri, 01 Aug 2025 16:08:19 GMT"} })
93742025-08-01T16:08:20.045ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 287.25979ms iteration = 22 status = {}
93752025-08-01T16:08:20.087ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
93762025-08-01T16:08:20.094ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e79f02ca-38d0-41c2-b86e-5a79a578b968", "content-length": "691", "date": "Fri, 01 Aug 2025 16:08:20 GMT"} })
93772025-08-01T16:08:20.094ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
93782025-08-01T16:08:20.094ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
93792025-08-01T16:08:20.094ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
93802025-08-01T16:08:20.095ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 337.276887ms iteration = 22 status = {}
93812025-08-01T16:08:20.125ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93822025-08-01T16:08:20.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93832025-08-01T16:08:20.127ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 3f21d9d5-3adf-463a-a05d-bc2e2e5d64ca, rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(4c7da70d-ede0-4107-abc5-5650a053be38) } rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
93842025-08-01T16:08:20.127ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93852025-08-01T16:08:20.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93862025-08-01T16:08:20.138ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
93872025-08-01T16:08:20.138ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 4c7da70d-ede0-4107-abc5-5650a053be38
93882025-08-01T16:08:20.138ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
93892025-08-01T16:08:20.138ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
93902025-08-01T16:08:20.138ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93912025-08-01T16:08:20.138ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93922025-08-01T16:08:20.138ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93932025-08-01T16:08:20.138ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
93942025-08-01T16:08:20.139ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93952025-08-01T16:08:20.139ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
93962025-08-01T16:08:20.139ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
93972025-08-01T16:08:20.139ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93982025-08-01T16:08:20.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93992025-08-01T16:08:20.142ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
94002025-08-01T16:08:20.142ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
94012025-08-01T16:08:20.257ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e9be53ce-2fb7-4fc0-a1ba-9866eab23d0a", "date": "Fri, 01 Aug 2025 16:08:20 GMT"} })
94022025-08-01T16:08:20.257ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch = Switch0
94032025-08-01T16:08:20.257ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
94042025-08-01T16:08:20.258ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "de2f9ffb-fa51-4660-8030-6b0eb4e49d48", "content-length": "682", "date": "Fri, 01 Aug 2025 16:08:20 GMT"} })
94052025-08-01T16:08:20.258ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94062025-08-01T16:08:20.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94072025-08-01T16:08:20.262ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94082025-08-01T16:08:20.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94092025-08-01T16:08:20.264ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94102025-08-01T16:08:20.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94112025-08-01T16:08:20.266ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94122025-08-01T16:08:20.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94132025-08-01T16:08:20.273ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 514.713045ms iteration = 22 status = {}
94142025-08-01T16:08:20.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8e206e85-f74e-49e6-9aee-eb28055d8ce4 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94152025-08-01T16:08:20.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8e206e85-f74e-49e6-9aee-eb28055d8ce4 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94162025-08-01T16:08:20.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2389 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8e206e85-f74e-49e6-9aee-eb28055d8ce4 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94172025-08-01T16:08:21.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 374dfcf1-3f1a-4195-84c1-511159c23870 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94182025-08-01T16:08:21.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 374dfcf1-3f1a-4195-84c1-511159c23870 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94192025-08-01T16:08:21.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2307 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 374dfcf1-3f1a-4195-84c1-511159c23870 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94202025-08-01T16:08:22.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c4376a10-49f4-44a0-b836-55f84af5d321 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94212025-08-01T16:08:22.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c4376a10-49f4-44a0-b836-55f84af5d321 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94222025-08-01T16:08:22.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2254 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c4376a10-49f4-44a0-b836-55f84af5d321 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94232025-08-01T16:08:23.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a64ac008-c286-4891-96fd-a85cc2f6ea83 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94242025-08-01T16:08:23.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a64ac008-c286-4891-96fd-a85cc2f6ea83 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94252025-08-01T16:08:23.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2546 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a64ac008-c286-4891-96fd-a85cc2f6ea83 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94262025-08-01T16:08:24.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1ddd643b-945e-4285-8e9a-7356687db972 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94272025-08-01T16:08:24.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1ddd643b-945e-4285-8e9a-7356687db972 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94282025-08-01T16:08:24.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1993 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1ddd643b-945e-4285-8e9a-7356687db972 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94292025-08-01T16:08:24.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 128 reason = Timeout
94302025-08-01T16:08:24.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
94312025-08-01T16:08:24.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
94322025-08-01T16:08:24.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94332025-08-01T16:08:24.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
94342025-08-01T16:08:24.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
94352025-08-01T16:08:24.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
94362025-08-01T16:08:24.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
94372025-08-01T16:08:24.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.082185ms iteration = 128 status = {"chicken_switches_updated":false}
94382025-08-01T16:08:25.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b63fa3c0-ddb4-400c-aaa4-8e9a3a47f743 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94392025-08-01T16:08:25.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b63fa3c0-ddb4-400c-aaa4-8e9a3a47f743 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94402025-08-01T16:08:25.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2532 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b63fa3c0-ddb4-400c-aaa4-8e9a3a47f743 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94412025-08-01T16:08:26.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 911e7fac-a200-4d53-9538-fc09da76aad4 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94422025-08-01T16:08:26.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 911e7fac-a200-4d53-9538-fc09da76aad4 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94432025-08-01T16:08:26.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1977 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 911e7fac-a200-4d53-9538-fc09da76aad4 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94442025-08-01T16:08:27.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3bfc1e24-b92a-4c6f-a4ef-014e8dc652fa roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94452025-08-01T16:08:27.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3bfc1e24-b92a-4c6f-a4ef-014e8dc652fa resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94462025-08-01T16:08:27.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2070 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3bfc1e24-b92a-4c6f-a4ef-014e8dc652fa response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94472025-08-01T16:08:28.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a9dd1b9a-c0f4-40bd-92ee-80d959ae91c0 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94482025-08-01T16:08:28.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a9dd1b9a-c0f4-40bd-92ee-80d959ae91c0 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94492025-08-01T16:08:28.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2300 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a9dd1b9a-c0f4-40bd-92ee-80d959ae91c0 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94502025-08-01T16:08:29.757ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
94512025-08-01T16:08:29.757ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94522025-08-01T16:08:29.757ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 129 reason = Timeout
94532025-08-01T16:08:29.757ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
94542025-08-01T16:08:29.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94552025-08-01T16:08:29.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
94562025-08-01T16:08:29.758ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
94572025-08-01T16:08:29.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94582025-08-01T16:08:29.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94592025-08-01T16:08:29.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94602025-08-01T16:08:29.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94612025-08-01T16:08:29.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94622025-08-01T16:08:29.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94632025-08-01T16:08:29.762ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.207487ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94642025-08-01T16:08:29.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
94652025-08-01T16:08:29.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
94662025-08-01T16:08:29.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
94672025-08-01T16:08:29.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
94682025-08-01T16:08:29.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94692025-08-01T16:08:29.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94702025-08-01T16:08:29.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
94712025-08-01T16:08:29.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.903239ms iteration = 129 status = {"chicken_switches_updated":false}
94722025-08-01T16:08:29.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94732025-08-01T16:08:29.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94742025-08-01T16:08:29.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94752025-08-01T16:08:29.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
94762025-08-01T16:08:29.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94772025-08-01T16:08:29.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94782025-08-01T16:08:29.783ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
94792025-08-01T16:08:29.783ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.990008ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
94802025-08-01T16:08:29.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 377d6c9a-e52b-4395-89a0-547f59cebb5d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94812025-08-01T16:08:29.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 377d6c9a-e52b-4395-89a0-547f59cebb5d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94822025-08-01T16:08:29.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1674 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 377d6c9a-e52b-4395-89a0-547f59cebb5d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94832025-08-01T16:08:29.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 525 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = df45be8b-821f-42e1-a02d-7d16c77205ee response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
94842025-08-01T16:08:30.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7d65da83-198d-481e-9744-b4e2d7f81132 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94852025-08-01T16:08:30.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7d65da83-198d-481e-9744-b4e2d7f81132 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94862025-08-01T16:08:30.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2454 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7d65da83-198d-481e-9744-b4e2d7f81132 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94872025-08-01T16:08:31.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 591c8b26-7fe8-43d4-8ca6-2fec5d5bd078 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94882025-08-01T16:08:31.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 591c8b26-7fe8-43d4-8ca6-2fec5d5bd078 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94892025-08-01T16:08:31.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2247 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 591c8b26-7fe8-43d4-8ca6-2fec5d5bd078 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94902025-08-01T16:08:32.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b89fe1ca-c596-48f1-bc02-1f9f9368c509 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94912025-08-01T16:08:32.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b89fe1ca-c596-48f1-bc02-1f9f9368c509 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94922025-08-01T16:08:32.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2534 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b89fe1ca-c596-48f1-bc02-1f9f9368c509 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94932025-08-01T16:08:33.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1cfff7e6-c046-4926-ab43-5fb1f8561d76 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94942025-08-01T16:08:33.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1cfff7e6-c046-4926-ab43-5fb1f8561d76 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94952025-08-01T16:08:33.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2385 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1cfff7e6-c046-4926-ab43-5fb1f8561d76 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
94962025-08-01T16:08:34.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 130 reason = Timeout
94972025-08-01T16:08:34.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
94982025-08-01T16:08:34.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
94992025-08-01T16:08:34.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95002025-08-01T16:08:34.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
95012025-08-01T16:08:34.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
95022025-08-01T16:08:34.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
95032025-08-01T16:08:34.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
95042025-08-01T16:08:34.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.046954ms iteration = 130 status = {"chicken_switches_updated":false}
95052025-08-01T16:08:34.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1eda87f0-d854-4fff-8119-c8487caaeb6b roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95062025-08-01T16:08:34.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1eda87f0-d854-4fff-8119-c8487caaeb6b resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95072025-08-01T16:08:34.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2232 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1eda87f0-d854-4fff-8119-c8487caaeb6b response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95082025-08-01T16:08:35.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8b14bea8-3fee-4787-bd11-3b2559986ae7 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95092025-08-01T16:08:35.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8b14bea8-3fee-4787-bd11-3b2559986ae7 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95102025-08-01T16:08:35.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2109 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8b14bea8-3fee-4787-bd11-3b2559986ae7 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95112025-08-01T16:08:36.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3a029e82-ab0e-48d9-8fc4-1e1e55a7e19d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95122025-08-01T16:08:36.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3a029e82-ab0e-48d9-8fc4-1e1e55a7e19d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95132025-08-01T16:08:36.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2399 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3a029e82-ab0e-48d9-8fc4-1e1e55a7e19d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95142025-08-01T16:08:37.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fc738ae0-5f22-4754-8b2c-1d9439c53a00 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95152025-08-01T16:08:37.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fc738ae0-5f22-4754-8b2c-1d9439c53a00 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95162025-08-01T16:08:37.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2142 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fc738ae0-5f22-4754-8b2c-1d9439c53a00 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95172025-08-01T16:08:38.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 62253cf6-0b6a-4c59-9b90-40b2706d1117 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95182025-08-01T16:08:38.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 62253cf6-0b6a-4c59-9b90-40b2706d1117 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95192025-08-01T16:08:38.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2603 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 62253cf6-0b6a-4c59-9b90-40b2706d1117 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95202025-08-01T16:08:39.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
95212025-08-01T16:08:39.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 131 reason = Timeout
95222025-08-01T16:08:39.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95232025-08-01T16:08:39.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
95242025-08-01T16:08:39.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
95252025-08-01T16:08:39.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95262025-08-01T16:08:39.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
95272025-08-01T16:08:39.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95282025-08-01T16:08:39.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95292025-08-01T16:08:39.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95302025-08-01T16:08:39.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95312025-08-01T16:08:39.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95322025-08-01T16:08:39.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95332025-08-01T16:08:39.763ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.253689ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95342025-08-01T16:08:39.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
95352025-08-01T16:08:39.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
95362025-08-01T16:08:39.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
95372025-08-01T16:08:39.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95382025-08-01T16:08:39.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95392025-08-01T16:08:39.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95402025-08-01T16:08:39.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
95412025-08-01T16:08:39.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.695734ms iteration = 131 status = {"chicken_switches_updated":false}
95422025-08-01T16:08:39.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95432025-08-01T16:08:39.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95442025-08-01T16:08:39.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95452025-08-01T16:08:39.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
95462025-08-01T16:08:39.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95472025-08-01T16:08:39.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95482025-08-01T16:08:39.784ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
95492025-08-01T16:08:39.784ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.594316ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
95502025-08-01T16:08:39.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1047 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = cf2a30b7-7b15-48a4-aad8-6f8e4ac18e68 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
95512025-08-01T16:08:39.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cf847318-6eab-4c5b-a18c-002086d097a5 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95522025-08-01T16:08:39.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cf847318-6eab-4c5b-a18c-002086d097a5 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95532025-08-01T16:08:39.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1590 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cf847318-6eab-4c5b-a18c-002086d097a5 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95542025-08-01T16:08:40.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0b2505e1-c819-405b-a8b9-d23c6b9da3a3 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95552025-08-01T16:08:40.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0b2505e1-c819-405b-a8b9-d23c6b9da3a3 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95562025-08-01T16:08:40.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2121 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0b2505e1-c819-405b-a8b9-d23c6b9da3a3 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95572025-08-01T16:08:41.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bd7f052a-f71e-443f-aad0-6337e7c0e74f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95582025-08-01T16:08:41.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bd7f052a-f71e-443f-aad0-6337e7c0e74f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95592025-08-01T16:08:41.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2803 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bd7f052a-f71e-443f-aad0-6337e7c0e74f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95602025-08-01T16:08:42.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ebde126d-33a1-423c-9c0b-800e3b27692c roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95612025-08-01T16:08:42.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ebde126d-33a1-423c-9c0b-800e3b27692c resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95622025-08-01T16:08:42.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2404 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ebde126d-33a1-423c-9c0b-800e3b27692c response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95632025-08-01T16:08:44.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c20c240a-5482-4389-bdff-2ac5fe48ccde roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95642025-08-01T16:08:44.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c20c240a-5482-4389-bdff-2ac5fe48ccde resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95652025-08-01T16:08:44.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2500 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c20c240a-5482-4389-bdff-2ac5fe48ccde response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95662025-08-01T16:08:44.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 132 reason = Timeout
95672025-08-01T16:08:44.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
95682025-08-01T16:08:44.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
95692025-08-01T16:08:44.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95702025-08-01T16:08:44.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
95712025-08-01T16:08:44.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
95722025-08-01T16:08:44.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
95732025-08-01T16:08:44.764ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
95742025-08-01T16:08:44.764ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.697783ms iteration = 132 status = {"chicken_switches_updated":false}
95752025-08-01T16:08:44.912ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::d]:36657
95762025-08-01T16:08:44.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = a27b5ce1-9e30-4d0e-9ca7-f3709bb93f0d roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
95772025-08-01T16:08:44.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = a27b5ce1-9e30-4d0e-9ca7-f3709bb93f0d resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
95782025-08-01T16:08:44.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2979 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = a27b5ce1-9e30-4d0e-9ca7-f3709bb93f0d response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
95792025-08-01T16:08:44.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = a6833c47-4c40-4122-8b2a-6ff933cf9ff1 roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
95802025-08-01T16:08:44.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = a6833c47-4c40-4122-8b2a-6ff933cf9ff1 resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
95812025-08-01T16:08:44.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1981 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = a6833c47-4c40-4122-8b2a-6ff933cf9ff1 response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
95822025-08-01T16:08:45.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 379ef77a-b9ea-4e17-8076-d7f790dc4be1 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95832025-08-01T16:08:45.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 379ef77a-b9ea-4e17-8076-d7f790dc4be1 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95842025-08-01T16:08:45.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2264 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 379ef77a-b9ea-4e17-8076-d7f790dc4be1 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95852025-08-01T16:08:46.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 013e81dd-b226-4fcb-87eb-538149ba5889 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95862025-08-01T16:08:46.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 013e81dd-b226-4fcb-87eb-538149ba5889 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95872025-08-01T16:08:46.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2362 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 013e81dd-b226-4fcb-87eb-538149ba5889 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95882025-08-01T16:08:47.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d3ebcaf1-03d2-400f-8d5a-409d40d74c8f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95892025-08-01T16:08:47.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d3ebcaf1-03d2-400f-8d5a-409d40d74c8f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95902025-08-01T16:08:47.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2277 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d3ebcaf1-03d2-400f-8d5a-409d40d74c8f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95912025-08-01T16:08:48.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8dc13a7e-ccbc-4e7b-b1b8-9e1cb3056928 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95922025-08-01T16:08:48.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8dc13a7e-ccbc-4e7b-b1b8-9e1cb3056928 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95932025-08-01T16:08:48.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2576 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8dc13a7e-ccbc-4e7b-b1b8-9e1cb3056928 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95942025-08-01T16:08:49.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fdec8de1-1761-40e7-b894-0ca5bd56590d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95952025-08-01T16:08:49.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fdec8de1-1761-40e7-b894-0ca5bd56590d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95962025-08-01T16:08:49.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2418 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fdec8de1-1761-40e7-b894-0ca5bd56590d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
95972025-08-01T16:08:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
95982025-08-01T16:08:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
95992025-08-01T16:08:49.687ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
96002025-08-01T16:08:49.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96012025-08-01T16:08:49.687ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
96022025-08-01T16:08:49.687ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-01 15:58:49.687312735 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
96032025-08-01T16:08:49.687ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
96042025-08-01T16:08:49.687ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
96052025-08-01T16:08:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
96062025-08-01T16:08:49.687ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
96072025-08-01T16:08:49.687ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
96082025-08-01T16:08:49.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96092025-08-01T16:08:49.687ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
96102025-08-01T16:08:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
96112025-08-01T16:08:49.687ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
96122025-08-01T16:08:49.687ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
96132025-08-01T16:08:49.687ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
96142025-08-01T16:08:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
96152025-08-01T16:08:49.687ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
96162025-08-01T16:08:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
96172025-08-01T16:08:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96182025-08-01T16:08:49.687ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cb706a84-a33b-442f-aac2-3a6eb5f3b330.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d688a68d-d771-4ac5-8e66-9efa94dbbea8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d688a68d-d771-4ac5-8e66-9efa94dbbea8.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 44225, tv_nsec: 704492764 } })
96192025-08-01T16:08:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96202025-08-01T16:08:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
96212025-08-01T16:08:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
96222025-08-01T16:08:49.687ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50fe31de-3241-42df-a386-de37ce323a34.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("58598327-8751-423c-a5ac-c610829651e2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 44225, tv_nsec: 704606037 } })
96232025-08-01T16:08:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
96242025-08-01T16:08:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
96252025-08-01T16:08:49.688ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
96262025-08-01T16:08:49.688ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.052932ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
96272025-08-01T16:08:49.688ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
96282025-08-01T16:08:49.688ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 947.358\u{b5}s iteration = 12 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
96292025-08-01T16:08:49.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96302025-08-01T16:08:49.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96312025-08-01T16:08:49.689ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96322025-08-01T16:08:49.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96332025-08-01T16:08:49.690ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.718072ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
96342025-08-01T16:08:49.691ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-01 15:58:49.687312735 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
96352025-08-01T16:08:49.691ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.95382ms iteration = 12 status = {"expiration":"2025-08-01T15:58:49.687312735Z","pruned":[]}
96362025-08-01T16:08:49.691ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44225, tv_nsec: 708137944 } })
96372025-08-01T16:08:49.691ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
96382025-08-01T16:08:49.692ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96392025-08-01T16:08:49.693ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96402025-08-01T16:08:49.693ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96412025-08-01T16:08:49.693ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44225, tv_nsec: 710195507 } })
96422025-08-01T16:08:49.693ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
96432025-08-01T16:08:49.697ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
96442025-08-01T16:08:49.697ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
96452025-08-01T16:08:49.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
96462025-08-01T16:08:49.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
96472025-08-01T16:08:49.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
96482025-08-01T16:08:49.699ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
96492025-08-01T16:08:49.699ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
96502025-08-01T16:08:49.699ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
96512025-08-01T16:08:49.699ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96522025-08-01T16:08:49.699ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
96532025-08-01T16:08:49.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96542025-08-01T16:08:49.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
96552025-08-01T16:08:49.700ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96562025-08-01T16:08:49.701ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96572025-08-01T16:08:49.704ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
96582025-08-01T16:08:49.704ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96592025-08-01T16:08:49.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96602025-08-01T16:08:49.705ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
96612025-08-01T16:08:49.705ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
96622025-08-01T16:08:49.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
96632025-08-01T16:08:49.706ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
96642025-08-01T16:08:49.706ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1
96652025-08-01T16:08:49.706ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.781\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1"}
96662025-08-01T16:08:49.710ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 16 reason = Timeout
96672025-08-01T16:08:49.710ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
96682025-08-01T16:08:49.710ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 14.081\u{b5}s iteration = 16 status = "Disabled"
96692025-08-01T16:08:49.710ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
96702025-08-01T16:08:49.710ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
96712025-08-01T16:08:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
96722025-08-01T16:08:49.710ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 12 reason = Timeout
96732025-08-01T16:08:49.710ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
96742025-08-01T16:08:49.711ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
96752025-08-01T16:08:49.711ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
96762025-08-01T16:08:49.711ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
96772025-08-01T16:08:49.711ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
96782025-08-01T16:08:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
96792025-08-01T16:08:49.711ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
96802025-08-01T16:08:49.711ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
96812025-08-01T16:08:49.711ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
96822025-08-01T16:08:49.711ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 12 reason = Timeout
96832025-08-01T16:08:49.711ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
96842025-08-01T16:08:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
96852025-08-01T16:08:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
96862025-08-01T16:08:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
96872025-08-01T16:08:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
96882025-08-01T16:08:49.718ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.395255ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
96892025-08-01T16:08:49.720ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
96902025-08-01T16:08:49.720ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 9.521969ms iteration = 12 status = {"by_rx":{},"error":null}
96912025-08-01T16:08:49.723ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96922025-08-01T16:08:49.726ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
96932025-08-01T16:08:49.726ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
96942025-08-01T16:08:49.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
96952025-08-01T16:08:49.728ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
96962025-08-01T16:08:49.728ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
96972025-08-01T16:08:49.728ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 17.606324ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
96982025-08-01T16:08:49.731ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
96992025-08-01T16:08:49.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
97002025-08-01T16:08:49.734ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 23.537404ms iteration = 12 status = {"dispatched":[],"errors":[],"glob_version":"173.0.0","globs_reprocessed":{},"no_receivers":[]}
97012025-08-01T16:08:49.752ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
97022025-08-01T16:08:49.752ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
97032025-08-01T16:08:49.752ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
97042025-08-01T16:08:49.752ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97052025-08-01T16:08:49.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97062025-08-01T16:08:49.754ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97072025-08-01T16:08:49.757ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
97082025-08-01T16:08:49.757ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 02fcb774-aa43-4052-9996-b85e2d1358b5 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
97092025-08-01T16:08:49.757ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97102025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 23 reason = Timeout
97112025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
97122025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
97132025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97142025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 18.69\u{b5}s iteration = 23 status = {"disabled":true,"errors":[],"sps":[]}
97152025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
97162025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
97172025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97182025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97192025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
97202025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97212025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
97222025-08-01T16:08:49.758ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
97232025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97242025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 23 reason = Timeout
97252025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
97262025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97272025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
97282025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97292025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
97302025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97312025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
97322025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97332025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
97342025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
97352025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
97362025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
97372025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
97382025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97392025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 133 reason = Timeout
97402025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
97412025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
97422025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97432025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
97442025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
97452025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97462025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97472025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97482025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97492025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97502025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97512025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
97522025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
97532025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97542025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97552025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97562025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
97572025-08-01T16:08:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97582025-08-01T16:08:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
97592025-08-01T16:08:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97602025-08-01T16:08:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
97612025-08-01T16:08:49.759ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97622025-08-01T16:08:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97632025-08-01T16:08:49.759ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97642025-08-01T16:08:49.759ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 23 reason = Timeout
97652025-08-01T16:08:49.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
97662025-08-01T16:08:49.759ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
97672025-08-01T16:08:49.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97682025-08-01T16:08:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97692025-08-01T16:08:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97702025-08-01T16:08:49.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
97712025-08-01T16:08:49.760ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97722025-08-01T16:08:49.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
97732025-08-01T16:08:49.764ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97742025-08-01T16:08:49.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97752025-08-01T16:08:49.765ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97762025-08-01T16:08:49.765ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97772025-08-01T16:08:49.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
97782025-08-01T16:08:49.770ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97792025-08-01T16:08:49.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97802025-08-01T16:08:49.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
97812025-08-01T16:08:49.770ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97822025-08-01T16:08:49.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97832025-08-01T16:08:49.770ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.437987ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
97842025-08-01T16:08:49.771ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97852025-08-01T16:08:49.771ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97862025-08-01T16:08:49.771ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
97872025-08-01T16:08:49.771ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97882025-08-01T16:08:49.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97892025-08-01T16:08:49.774ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97902025-08-01T16:08:49.774ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97912025-08-01T16:08:49.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97922025-08-01T16:08:49.774ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97932025-08-01T16:08:49.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97942025-08-01T16:08:49.776ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97952025-08-01T16:08:49.776ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 18.519061ms iteration = 23 status = {"errors":[],"requests_created_ok":[]}
97962025-08-01T16:08:49.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
97972025-08-01T16:08:49.777ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97982025-08-01T16:08:49.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97992025-08-01T16:08:49.778ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98002025-08-01T16:08:49.778ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98012025-08-01T16:08:49.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98022025-08-01T16:08:49.779ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98032025-08-01T16:08:49.781ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
98042025-08-01T16:08:49.781ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
98052025-08-01T16:08:49.781ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 02fcb774-aa43-4052-9996-b85e2d1358b5 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
98062025-08-01T16:08:49.781ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
98072025-08-01T16:08:49.781ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-01 15:58:34.032744 UTC dns_group = internal generation = 1
98082025-08-01T16:08:49.781ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 94.157175ms iteration = 12 status = {"generation":1}
98092025-08-01T16:08:49.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
98102025-08-01T16:08:49.781ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98112025-08-01T16:08:49.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98122025-08-01T16:08:49.782ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44225, tv_nsec: 798810284 } })
98132025-08-01T16:08:49.782ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
98142025-08-01T16:08:49.782ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98152025-08-01T16:08:49.782ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98162025-08-01T16:08:49.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98172025-08-01T16:08:49.783ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
98182025-08-01T16:08:49.783ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98192025-08-01T16:08:49.783ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
98202025-08-01T16:08:49.783ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 25.482303ms iteration = 133 status = {"chicken_switches_updated":false}
98212025-08-01T16:08:49.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98222025-08-01T16:08:49.784ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
98232025-08-01T16:08:49.784ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
98242025-08-01T16:08:49.784ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 73.600421ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
98252025-08-01T16:08:49.785ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98262025-08-01T16:08:49.786ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98272025-08-01T16:08:49.786ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98282025-08-01T16:08:49.786ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98292025-08-01T16:08:49.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98302025-08-01T16:08:49.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98312025-08-01T16:08:49.788ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98322025-08-01T16:08:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
98332025-08-01T16:08:49.789ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98342025-08-01T16:08:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98352025-08-01T16:08:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
98362025-08-01T16:08:49.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98372025-08-01T16:08:49.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98382025-08-01T16:08:49.801ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 42.831109ms iteration = 26 status = {"physical_disks_added":0}
98392025-08-01T16:08:49.823ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
98402025-08-01T16:08:49.823ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 64.051802ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
98412025-08-01T16:08:49.833ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 74.951963ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
98422025-08-01T16:08:49.837ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98432025-08-01T16:08:49.839ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
98442025-08-01T16:08:49.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
98452025-08-01T16:08:49.840ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
98462025-08-01T16:08:49.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
98472025-08-01T16:08:49.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
98482025-08-01T16:08:49.841ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
98492025-08-01T16:08:49.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
98502025-08-01T16:08:49.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98512025-08-01T16:08:49.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98522025-08-01T16:08:49.850ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
98532025-08-01T16:08:49.850ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 91.913857ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
98542025-08-01T16:08:49.850ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 92.272188ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
98552025-08-01T16:08:49.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
98562025-08-01T16:08:49.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
98572025-08-01T16:08:49.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98582025-08-01T16:08:49.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98592025-08-01T16:08:49.853ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98602025-08-01T16:08:49.853ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
98612025-08-01T16:08:49.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98622025-08-01T16:08:49.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98632025-08-01T16:08:49.857ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
98642025-08-01T16:08:49.857ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6482e44c-c860-4033-b945-5707d343a59d dns_zone_name = oxide.test found_so_far = 0 version = 2
98652025-08-01T16:08:49.857ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
98662025-08-01T16:08:49.857ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98672025-08-01T16:08:49.857ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98682025-08-01T16:08:49.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98692025-08-01T16:08:49.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
98702025-08-01T16:08:49.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98712025-08-01T16:08:49.862ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98722025-08-01T16:08:49.866ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
98732025-08-01T16:08:49.866ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98742025-08-01T16:08:49.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98752025-08-01T16:08:49.866ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98762025-08-01T16:08:49.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 108.623243ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
98772025-08-01T16:08:49.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
98782025-08-01T16:08:49.869ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98792025-08-01T16:08:49.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98802025-08-01T16:08:49.872ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 114.060398ms iteration = 23 status = 0
98812025-08-01T16:08:49.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98822025-08-01T16:08:49.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98832025-08-01T16:08:49.887ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98842025-08-01T16:08:49.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98852025-08-01T16:08:49.891ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6482e44c-c860-4033-b945-5707d343a59d dns_zone_name = oxide.test found_so_far = 4 version = 2
98862025-08-01T16:08:49.891ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
98872025-08-01T16:08:49.891ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-01 15:58:34.713515 UTC dns_group = external generation = 2
98882025-08-01T16:08:49.891ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 204.14373ms iteration = 12 status = {"generation":2}
98892025-08-01T16:08:49.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
98902025-08-01T16:08:49.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
98912025-08-01T16:08:49.910ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 152.086631ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
98922025-08-01T16:08:49.915ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
98932025-08-01T16:08:49.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
98942025-08-01T16:08:49.918ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98952025-08-01T16:08:49.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 573 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 65d59b43-a5bb-4da9-a402-2e8ad8aaeee0 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
98962025-08-01T16:08:49.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
98972025-08-01T16:08:49.922ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
98982025-08-01T16:08:49.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
98992025-08-01T16:08:49.924ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:391
99002025-08-01T16:08:49.924ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 165.211639ms iteration = 23 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
99012025-08-01T16:08:49.931ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
99022025-08-01T16:08:49.931ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99032025-08-01T16:08:49.931ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8ac831f-dc07-4107-b492-313d46b06870", "content-length": "26", "date": "Fri, 01 Aug 2025 16:08:49 GMT"} })
99042025-08-01T16:08:49.931ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99052025-08-01T16:08:49.933ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
99062025-08-01T16:08:49.937ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 179.09822ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
99072025-08-01T16:08:49.942ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
99082025-08-01T16:08:49.942ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
99092025-08-01T16:08:49.942ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 184.494754ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
99102025-08-01T16:08:49.947ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-01T15:57:44.766264Z, time_modified: 2025-08-01T15:57:44.766264Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: eec17da7-eb17-4917-8728-908698b69bbe, db_silo: Silo { identity: SiloIdentity { id: eec17da7-eb17-4917-8728-908698b69bbe, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-01T15:58:34.653875Z, time_modified: 2025-08-01T15:58:34.653875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: eec17da7-eb17-4917-8728-908698b69bbe, db_silo: Silo { identity: SiloIdentity { id: eec17da7-eb17-4917-8728-908698b69bbe, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-01T15:58:34.653875Z, time_modified: 2025-08-01T15:58:34.653875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575" }] }) }
99112025-08-01T16:08:49.947ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 260.434817ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"eec17da7-eb17-4917-8728-908698b69bbe","tls_certs":["b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575"]}},"default_endpoint":{"silo_id":"eec17da7-eb17-4917-8728-908698b69bbe","tls_certs":["b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
99122025-08-01T16:08:49.979ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99132025-08-01T16:08:49.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99142025-08-01T16:08:49.992ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99152025-08-01T16:08:49.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99162025-08-01T16:08:49.995ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99172025-08-01T16:08:49.998ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99182025-08-01T16:08:49.998ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99192025-08-01T16:08:49.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99202025-08-01T16:08:50.000ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99212025-08-01T16:08:50.003ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99222025-08-01T16:08:50.003ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99232025-08-01T16:08:50.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99242025-08-01T16:08:50.035ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
99252025-08-01T16:08:50.035ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 324.753377ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
99262025-08-01T16:08:50.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5ef57ba7-743f-4c46-b49b-fc3caeb7bc61 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
99272025-08-01T16:08:50.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5ef57ba7-743f-4c46-b49b-fc3caeb7bc61 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
99282025-08-01T16:08:50.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2649 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5ef57ba7-743f-4c46-b49b-fc3caeb7bc61 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
99292025-08-01T16:08:50.127ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
99302025-08-01T16:08:50.146ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
99312025-08-01T16:08:50.146ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99322025-08-01T16:08:50.151ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "524d8cc7-d7ed-479e-95cd-38fdf6abf780", "content-length": "372", "date": "Fri, 01 Aug 2025 16:08:50 GMT"} })
99332025-08-01T16:08:50.151ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99342025-08-01T16:08:50.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99352025-08-01T16:08:50.163ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
99362025-08-01T16:08:50.174ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
99372025-08-01T16:08:50.174ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
99382025-08-01T16:08:50.174ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ceeb5081-2651-4379-93b9-a9a2a6ec49d5", "date": "Fri, 01 Aug 2025 16:08:50 GMT"} })
99392025-08-01T16:08:50.174ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99402025-08-01T16:08:50.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99412025-08-01T16:08:50.176ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99422025-08-01T16:08:50.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99432025-08-01T16:08:50.180ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99442025-08-01T16:08:50.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99452025-08-01T16:08:50.183ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
99462025-08-01T16:08:50.183ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99472025-08-01T16:08:50.184ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fdd08592-e6b0-4acf-b89c-8f7fddcef7c6", "date": "Fri, 01 Aug 2025 16:08:50 GMT"} })
99482025-08-01T16:08:50.186ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 428.126091ms iteration = 23 status = {}
99492025-08-01T16:08:50.188ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
99502025-08-01T16:08:50.188ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99512025-08-01T16:08:50.189ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7fbfef40-1d19-41a7-aeac-ed851fdb5ce4", "content-length": "26", "date": "Fri, 01 Aug 2025 16:08:49 GMT"} })
99522025-08-01T16:08:50.189ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99532025-08-01T16:08:50.191ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
99542025-08-01T16:08:50.212ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
99552025-08-01T16:08:50.212ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "21a7a020-83d0-483f-bfc6-cff5a9addb3e", "content-length": "691", "date": "Fri, 01 Aug 2025 16:08:50 GMT"} })
99562025-08-01T16:08:50.212ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
99572025-08-01T16:08:50.212ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
99582025-08-01T16:08:50.212ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
99592025-08-01T16:08:50.214ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 456.560523ms iteration = 23 status = {}
99602025-08-01T16:08:50.216ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
99612025-08-01T16:08:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
99622025-08-01T16:08:50.219ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 531.740423ms iteration = 23 status = null
99632025-08-01T16:08:50.316ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 zone_address = fd00:1122:3344:101::2
99642025-08-01T16:08:50.316ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99652025-08-01T16:08:50.316ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f27efd1-4cea-4b05-8274-7385cfb767fb", "content-length": "26", "date": "Fri, 01 Aug 2025 16:08:49 GMT"} })
99662025-08-01T16:08:50.316ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99672025-08-01T16:08:50.318ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
99682025-08-01T16:08:50.321ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 633.629723ms iteration = 23 status = {}
99692025-08-01T16:08:50.440ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
99702025-08-01T16:08:50.441ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "545346bd-f8f7-4cc4-b202-db95795261ca", "date": "Fri, 01 Aug 2025 16:08:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
99712025-08-01T16:08:50.441ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
99722025-08-01T16:08:50.441ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
99732025-08-01T16:08:50.442ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "1a434611-6f99-4648-9fac-3dae8883928f", "date": "Fri, 01 Aug 2025 16:08:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
99742025-08-01T16:08:50.442ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
99752025-08-01T16:08:50.444ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
99762025-08-01T16:08:50.444ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 757.475308ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
99772025-08-01T16:08:50.503ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
99782025-08-01T16:08:50.504ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "0a188817-5a31-4a1f-841b-8b459f80961e", "date": "Fri, 01 Aug 2025 16:08:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
99792025-08-01T16:08:50.504ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
99802025-08-01T16:08:50.506ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5d8e3fba-f2fc-46c7-b472-e9fa74eb32b2", "date": "Fri, 01 Aug 2025 16:08:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
99812025-08-01T16:08:50.506ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
99822025-08-01T16:08:50.508ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b3cfafd0-a82d-4b00-8181-d927c1120686", "date": "Fri, 01 Aug 2025 16:08:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
99832025-08-01T16:08:50.508ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
99842025-08-01T16:08:50.511ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
99852025-08-01T16:08:50.511ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 823.653934ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
99862025-08-01T16:08:50.531ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99872025-08-01T16:08:50.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99882025-08-01T16:08:50.533ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 3f21d9d5-3adf-463a-a05d-bc2e2e5d64ca, rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(4c7da70d-ede0-4107-abc5-5650a053be38) } rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
99892025-08-01T16:08:50.533ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99902025-08-01T16:08:50.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99912025-08-01T16:08:50.544ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
99922025-08-01T16:08:50.544ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 4c7da70d-ede0-4107-abc5-5650a053be38
99932025-08-01T16:08:50.544ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
99942025-08-01T16:08:50.544ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
99952025-08-01T16:08:50.544ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99962025-08-01T16:08:50.544ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99972025-08-01T16:08:50.544ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99982025-08-01T16:08:50.544ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99992025-08-01T16:08:50.544ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100002025-08-01T16:08:50.544ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
100012025-08-01T16:08:50.545ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
100022025-08-01T16:08:50.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100032025-08-01T16:08:50.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100042025-08-01T16:08:50.547ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
100052025-08-01T16:08:50.547ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
100062025-08-01T16:08:50.659ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4c330ea7-ceb0-4b46-bf49-0f54e9ab5f9e", "date": "Fri, 01 Aug 2025 16:08:49 GMT"} })
100072025-08-01T16:08:50.660ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch = Switch0
100082025-08-01T16:08:50.660ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
100092025-08-01T16:08:50.660ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2effc8a-7d34-46ca-97d6-a00d1552c80a", "content-length": "682", "date": "Fri, 01 Aug 2025 16:08:50 GMT"} })
100102025-08-01T16:08:50.660ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100112025-08-01T16:08:50.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100122025-08-01T16:08:50.663ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100132025-08-01T16:08:50.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100142025-08-01T16:08:50.666ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100152025-08-01T16:08:50.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100162025-08-01T16:08:50.668ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100172025-08-01T16:08:50.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100182025-08-01T16:08:50.675ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 917.100537ms iteration = 23 status = {}
100192025-08-01T16:08:50.729ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 4
100202025-08-01T16:08:50.729ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221
100212025-08-01T16:08:50.760ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
100222025-08-01T16:08:50.760ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:41557
100232025-08-01T16:08:50.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:41557 req_id = 012e96a3-62bc-46f8-bc05-89abe532fdfc roles = RoleSet { roles: {} } uri = /metrics/producers
100242025-08-01T16:08:50.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:41557 req_id = 012e96a3-62bc-46f8-bc05-89abe532fdfc resource = Database result = Ok(()) uri = /metrics/producers
100252025-08-01T16:08:50.800ZINFOnexus: assigned collector to new producer collector_id = 7bf2727d-8ae8-417c-81cf-59aa0ad1690b file = nexus/src/app/oximeter.rs:76 producer_id = 7248190d-c184-423c-8431-31fe40a79e2e
100262025-08-01T16:08:50.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 40613 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:41557 req_id = 012e96a3-62bc-46f8-bc05-89abe532fdfc response_code = 201 uri = /metrics/producers
100272025-08-01T16:08:50.800ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "012e96a3-62bc-46f8-bc05-89abe532fdfc", "content-length": "41", "date": "Fri, 01 Aug 2025 16:08:50 GMT"} })
100282025-08-01T16:08:50.801ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
100292025-08-01T16:08:51.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5adc5d62-4a2f-4337-9c11-18a210058b26 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
100302025-08-01T16:08:51.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5adc5d62-4a2f-4337-9c11-18a210058b26 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
100312025-08-01T16:08:51.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2024 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5adc5d62-4a2f-4337-9c11-18a210058b26 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
100322025-08-01T16:08:52.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8c3c93f1-f0cb-49ef-b4cd-24d10642f9e1 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
100332025-08-01T16:08:52.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8c3c93f1-f0cb-49ef-b4cd-24d10642f9e1 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
100342025-08-01T16:08:52.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2228 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8c3c93f1-f0cb-49ef-b4cd-24d10642f9e1 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
100352025-08-01T16:08:53.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 711a0cb5-a957-4c37-a285-6476af0e5d60 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
100362025-08-01T16:08:53.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 711a0cb5-a957-4c37-a285-6476af0e5d60 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
100372025-08-01T16:08:53.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2664 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 711a0cb5-a957-4c37-a285-6476af0e5d60 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
100382025-08-01T16:08:54.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b30741c7-15f3-450e-b79d-e02af090a2b2 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
100392025-08-01T16:08:54.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b30741c7-15f3-450e-b79d-e02af090a2b2 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
100402025-08-01T16:08:54.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2237 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b30741c7-15f3-450e-b79d-e02af090a2b2 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
100412025-08-01T16:08:54.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 134 reason = Timeout
100422025-08-01T16:08:54.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
100432025-08-01T16:08:54.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
100442025-08-01T16:08:54.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100452025-08-01T16:08:54.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
100462025-08-01T16:08:54.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
100472025-08-01T16:08:54.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
100482025-08-01T16:08:54.764ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
100492025-08-01T16:08:54.764ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.804397ms iteration = 134 status = {"chicken_switches_updated":false}
100502025-08-01T16:08:55.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dc91d2ff-a221-4322-a136-bfe2070d22ba roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
100512025-08-01T16:08:55.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dc91d2ff-a221-4322-a136-bfe2070d22ba resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
100522025-08-01T16:08:55.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2253 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dc91d2ff-a221-4322-a136-bfe2070d22ba response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
100532025-08-01T16:08:56.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 03946ed2-c7a1-4279-8557-18c50c7e6a35 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
100542025-08-01T16:08:56.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 03946ed2-c7a1-4279-8557-18c50c7e6a35 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
100552025-08-01T16:08:56.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2185 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 03946ed2-c7a1-4279-8557-18c50c7e6a35 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
100562025-08-01T16:08:57.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f7c28d03-0d9c-49e2-a181-c258abf25b43 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
100572025-08-01T16:08:57.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f7c28d03-0d9c-49e2-a181-c258abf25b43 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
100582025-08-01T16:08:57.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1893 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f7c28d03-0d9c-49e2-a181-c258abf25b43 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
100592025-08-01T16:08:58.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 27b77516-c4e6-4842-8e97-137dfa178157 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
100602025-08-01T16:08:58.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 27b77516-c4e6-4842-8e97-137dfa178157 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
100612025-08-01T16:08:58.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2202 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 27b77516-c4e6-4842-8e97-137dfa178157 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
100622025-08-01T16:08:59.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6f7f8b94-7003-48d6-b6ab-52e92c75d9c7 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
100632025-08-01T16:08:59.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6f7f8b94-7003-48d6-b6ab-52e92c75d9c7 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
100642025-08-01T16:08:59.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2231 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6f7f8b94-7003-48d6-b6ab-52e92c75d9c7 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
100652025-08-01T16:08:59.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
100662025-08-01T16:08:59.759ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100672025-08-01T16:08:59.759ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 135 reason = Timeout
100682025-08-01T16:08:59.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
100692025-08-01T16:08:59.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
100702025-08-01T16:08:59.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100712025-08-01T16:08:59.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100722025-08-01T16:08:59.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100732025-08-01T16:08:59.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
100742025-08-01T16:08:59.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100752025-08-01T16:08:59.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100762025-08-01T16:08:59.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100772025-08-01T16:08:59.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100782025-08-01T16:08:59.763ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.863418ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100792025-08-01T16:08:59.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100802025-08-01T16:08:59.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100812025-08-01T16:08:59.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100822025-08-01T16:08:59.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
100832025-08-01T16:08:59.766ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
100842025-08-01T16:08:59.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
100852025-08-01T16:08:59.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100862025-08-01T16:08:59.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100872025-08-01T16:08:59.768ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
100882025-08-01T16:08:59.768ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 9.263341ms iteration = 135 status = {"chicken_switches_updated":false}
100892025-08-01T16:08:59.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100902025-08-01T16:08:59.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
100912025-08-01T16:08:59.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100922025-08-01T16:08:59.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100932025-08-01T16:08:59.789ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
100942025-08-01T16:08:59.789ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.623088ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
100952025-08-01T16:08:59.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = 51cc214d-56ae-4d90-a980-dc8e2aaf146d roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
100962025-08-01T16:08:59.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = 51cc214d-56ae-4d90-a980-dc8e2aaf146d resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
100972025-08-01T16:08:59.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2940 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = 51cc214d-56ae-4d90-a980-dc8e2aaf146d response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
100982025-08-01T16:08:59.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = 6bdd39a3-c7e9-4b32-bd10-c33dae278937 roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
100992025-08-01T16:08:59.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = 6bdd39a3-c7e9-4b32-bd10-c33dae278937 resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
101002025-08-01T16:08:59.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 538 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = e6a29983-9bd2-4870-bc73-47fa6f6291c0 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
101012025-08-01T16:08:59.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 4966 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = 6bdd39a3-c7e9-4b32-bd10-c33dae278937 response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
101022025-08-01T16:09:00.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 550469c2-5747-4ee9-b444-1ce83a161838 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101032025-08-01T16:09:00.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 550469c2-5747-4ee9-b444-1ce83a161838 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101042025-08-01T16:09:00.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2517 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 550469c2-5747-4ee9-b444-1ce83a161838 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101052025-08-01T16:09:01.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8a09d06f-93b2-49dc-9d63-a516d26012d5 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101062025-08-01T16:09:01.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8a09d06f-93b2-49dc-9d63-a516d26012d5 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101072025-08-01T16:09:01.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2301 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8a09d06f-93b2-49dc-9d63-a516d26012d5 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101082025-08-01T16:09:02.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1b12ee3e-fb63-4cab-a214-a03423b3905d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101092025-08-01T16:09:02.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1b12ee3e-fb63-4cab-a214-a03423b3905d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101102025-08-01T16:09:02.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1747 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1b12ee3e-fb63-4cab-a214-a03423b3905d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101112025-08-01T16:09:03.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d958eadb-1bc2-4963-879f-b24c26c9ebca roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101122025-08-01T16:09:03.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d958eadb-1bc2-4963-879f-b24c26c9ebca resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101132025-08-01T16:09:03.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2311 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d958eadb-1bc2-4963-879f-b24c26c9ebca response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101142025-08-01T16:09:04.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d9bad909-a6bc-4692-ac6b-d58a3e36e6de roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101152025-08-01T16:09:04.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d9bad909-a6bc-4692-ac6b-d58a3e36e6de resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101162025-08-01T16:09:04.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2688 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d9bad909-a6bc-4692-ac6b-d58a3e36e6de response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101172025-08-01T16:09:04.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 136 reason = Timeout
101182025-08-01T16:09:04.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
101192025-08-01T16:09:04.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
101202025-08-01T16:09:04.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101212025-08-01T16:09:04.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
101222025-08-01T16:09:04.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
101232025-08-01T16:09:04.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
101242025-08-01T16:09:04.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
101252025-08-01T16:09:04.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.464806ms iteration = 136 status = {"chicken_switches_updated":false}
101262025-08-01T16:09:05.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 66992842-78f9-4ecf-98e9-689608c7eb82 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101272025-08-01T16:09:05.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 66992842-78f9-4ecf-98e9-689608c7eb82 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101282025-08-01T16:09:05.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2097 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 66992842-78f9-4ecf-98e9-689608c7eb82 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101292025-08-01T16:09:06.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 10413127-ca3a-4ff6-8bcc-adc2e4ef974f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101302025-08-01T16:09:06.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 10413127-ca3a-4ff6-8bcc-adc2e4ef974f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101312025-08-01T16:09:06.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2395 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 10413127-ca3a-4ff6-8bcc-adc2e4ef974f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101322025-08-01T16:09:07.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 33c88380-846d-467f-b549-2ff157b4218b roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101332025-08-01T16:09:07.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 33c88380-846d-467f-b549-2ff157b4218b resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101342025-08-01T16:09:07.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2115 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 33c88380-846d-467f-b549-2ff157b4218b response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101352025-08-01T16:09:08.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 98791b33-57f3-4d75-ac15-a4963384eedb roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101362025-08-01T16:09:08.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 98791b33-57f3-4d75-ac15-a4963384eedb resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101372025-08-01T16:09:08.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2292 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 98791b33-57f3-4d75-ac15-a4963384eedb response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101382025-08-01T16:09:09.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 38256914-8fc9-44f7-b1ea-642385a8037e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101392025-08-01T16:09:09.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 38256914-8fc9-44f7-b1ea-642385a8037e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101402025-08-01T16:09:09.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2644 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 38256914-8fc9-44f7-b1ea-642385a8037e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101412025-08-01T16:09:09.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
101422025-08-01T16:09:09.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101432025-08-01T16:09:09.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 137 reason = Timeout
101442025-08-01T16:09:09.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
101452025-08-01T16:09:09.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101462025-08-01T16:09:09.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
101472025-08-01T16:09:09.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
101482025-08-01T16:09:09.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101492025-08-01T16:09:09.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101502025-08-01T16:09:09.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101512025-08-01T16:09:09.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101522025-08-01T16:09:09.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101532025-08-01T16:09:09.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101542025-08-01T16:09:09.762ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.230088ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101552025-08-01T16:09:09.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101562025-08-01T16:09:09.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101572025-08-01T16:09:09.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
101582025-08-01T16:09:09.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
101592025-08-01T16:09:09.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101602025-08-01T16:09:09.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
101612025-08-01T16:09:09.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101622025-08-01T16:09:09.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101632025-08-01T16:09:09.767ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
101642025-08-01T16:09:09.767ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 9.814367ms iteration = 137 status = {"chicken_switches_updated":false}
101652025-08-01T16:09:09.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101662025-08-01T16:09:09.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
101672025-08-01T16:09:09.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101682025-08-01T16:09:09.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101692025-08-01T16:09:09.784ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
101702025-08-01T16:09:09.784ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.930316ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
101712025-08-01T16:09:09.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 543 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 8ed439c8-c68b-40d5-8269-146f613120fc response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
101722025-08-01T16:09:10.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 802be0e9-49fe-4cb5-80a2-d72c7aa84c21 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101732025-08-01T16:09:10.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 802be0e9-49fe-4cb5-80a2-d72c7aa84c21 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101742025-08-01T16:09:10.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2613 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 802be0e9-49fe-4cb5-80a2-d72c7aa84c21 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101752025-08-01T16:09:11.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 436ed97d-711f-434b-9a9e-0c1c5bd66f20 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101762025-08-01T16:09:11.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 436ed97d-711f-434b-9a9e-0c1c5bd66f20 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101772025-08-01T16:09:11.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2125 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 436ed97d-711f-434b-9a9e-0c1c5bd66f20 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101782025-08-01T16:09:12.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 155d638b-4175-488e-9dda-26dc3fa0fe94 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101792025-08-01T16:09:12.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 155d638b-4175-488e-9dda-26dc3fa0fe94 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101802025-08-01T16:09:12.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1966 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 155d638b-4175-488e-9dda-26dc3fa0fe94 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101812025-08-01T16:09:13.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 97d024ce-b6c8-4120-9882-a8c613ed7ead roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101822025-08-01T16:09:13.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 97d024ce-b6c8-4120-9882-a8c613ed7ead resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101832025-08-01T16:09:13.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2536 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 97d024ce-b6c8-4120-9882-a8c613ed7ead response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101842025-08-01T16:09:14.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c934822a-b020-4db0-a678-34e040a43f5a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101852025-08-01T16:09:14.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c934822a-b020-4db0-a678-34e040a43f5a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101862025-08-01T16:09:14.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2184 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c934822a-b020-4db0-a678-34e040a43f5a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
101872025-08-01T16:09:14.757ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 138 reason = Timeout
101882025-08-01T16:09:14.757ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
101892025-08-01T16:09:14.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
101902025-08-01T16:09:14.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101912025-08-01T16:09:14.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
101922025-08-01T16:09:14.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
101932025-08-01T16:09:14.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
101942025-08-01T16:09:14.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
101952025-08-01T16:09:14.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.475756ms iteration = 138 status = {"chicken_switches_updated":false}
101962025-08-01T16:09:14.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = fd74db8b-c46e-4cc3-9090-26a15837762c roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
101972025-08-01T16:09:14.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = fd74db8b-c46e-4cc3-9090-26a15837762c resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
101982025-08-01T16:09:14.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3240 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = fd74db8b-c46e-4cc3-9090-26a15837762c response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
101992025-08-01T16:09:14.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = f5ece1f8-b902-437b-a3ff-9d80c4d2f204 roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
102002025-08-01T16:09:14.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = f5ece1f8-b902-437b-a3ff-9d80c4d2f204 resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
102012025-08-01T16:09:14.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2545 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = f5ece1f8-b902-437b-a3ff-9d80c4d2f204 response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
102022025-08-01T16:09:15.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b1354fce-7c9d-45cb-bfa2-17df36d1888a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
102032025-08-01T16:09:15.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b1354fce-7c9d-45cb-bfa2-17df36d1888a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
102042025-08-01T16:09:15.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2071 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b1354fce-7c9d-45cb-bfa2-17df36d1888a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
102052025-08-01T16:09:16.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c3d0c655-869b-481f-9229-97c2eef67e2c roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
102062025-08-01T16:09:16.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c3d0c655-869b-481f-9229-97c2eef67e2c resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
102072025-08-01T16:09:16.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2430 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c3d0c655-869b-481f-9229-97c2eef67e2c response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
102082025-08-01T16:09:17.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 92eb6d38-9189-4edb-9108-89ae7b0adbc5 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
102092025-08-01T16:09:17.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 92eb6d38-9189-4edb-9108-89ae7b0adbc5 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
102102025-08-01T16:09:17.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2535 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 92eb6d38-9189-4edb-9108-89ae7b0adbc5 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
102112025-08-01T16:09:18.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 417728ca-1c79-4bfc-bd24-277914bb4f15 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
102122025-08-01T16:09:18.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 417728ca-1c79-4bfc-bd24-277914bb4f15 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
102132025-08-01T16:09:18.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1820 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 417728ca-1c79-4bfc-bd24-277914bb4f15 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
102142025-08-01T16:09:19.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f3addaa1-b943-4105-8b30-c3ba65922205 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
102152025-08-01T16:09:19.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f3addaa1-b943-4105-8b30-c3ba65922205 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
102162025-08-01T16:09:19.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2595 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f3addaa1-b943-4105-8b30-c3ba65922205 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
102172025-08-01T16:09:19.687ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
102182025-08-01T16:09:19.687ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
102192025-08-01T16:09:19.687ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
102202025-08-01T16:09:19.687ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
102212025-08-01T16:09:19.687ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
102222025-08-01T16:09:19.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
102232025-08-01T16:09:19.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
102242025-08-01T16:09:19.690ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44255, tv_nsec: 706843828 } })
102252025-08-01T16:09:19.690ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44255, tv_nsec: 707026964 } })
102262025-08-01T16:09:19.690ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
102272025-08-01T16:09:19.690ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
102282025-08-01T16:09:19.690ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.344341ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
102292025-08-01T16:09:19.757ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
102302025-08-01T16:09:19.757ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
102312025-08-01T16:09:19.757ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
102322025-08-01T16:09:19.757ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
102332025-08-01T16:09:19.757ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102342025-08-01T16:09:19.757ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102352025-08-01T16:09:19.757ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
102362025-08-01T16:09:19.757ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
102372025-08-01T16:09:19.757ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102382025-08-01T16:09:19.757ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
102392025-08-01T16:09:19.757ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102402025-08-01T16:09:19.757ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
102412025-08-01T16:09:19.757ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102422025-08-01T16:09:19.757ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
102432025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
102442025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
102452025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 139 reason = Timeout
102462025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
102472025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
102482025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
102492025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
102502025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
102512025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102522025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
102532025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
102542025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
102552025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
102562025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 24 reason = Timeout
102572025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
102582025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
102592025-08-01T16:09:19.758ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
102602025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102612025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 24 reason = Timeout
102622025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 10.8\u{b5}s iteration = 24 status = {"disabled":true,"errors":[],"sps":[]}
102632025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102642025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
102652025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102662025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102672025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
102682025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
102692025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
102702025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102712025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
102722025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102732025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102742025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
102752025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102762025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102772025-08-01T16:09:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
102782025-08-01T16:09:19.759ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 24 reason = Timeout
102792025-08-01T16:09:19.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
102802025-08-01T16:09:19.759ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
102812025-08-01T16:09:19.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102822025-08-01T16:09:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102832025-08-01T16:09:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
102842025-08-01T16:09:19.760ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102852025-08-01T16:09:19.761ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102862025-08-01T16:09:19.761ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102872025-08-01T16:09:19.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
102882025-08-01T16:09:19.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102892025-08-01T16:09:19.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
102902025-08-01T16:09:19.763ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102912025-08-01T16:09:19.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
102922025-08-01T16:09:19.764ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102932025-08-01T16:09:19.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
102942025-08-01T16:09:19.764ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102952025-08-01T16:09:19.764ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102962025-08-01T16:09:19.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102972025-08-01T16:09:19.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
102982025-08-01T16:09:19.765ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
102992025-08-01T16:09:19.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103002025-08-01T16:09:19.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
103012025-08-01T16:09:19.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
103022025-08-01T16:09:19.767ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
103032025-08-01T16:09:19.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103042025-08-01T16:09:19.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
103052025-08-01T16:09:19.768ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
103062025-08-01T16:09:19.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
103072025-08-01T16:09:19.768ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
103082025-08-01T16:09:19.768ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103092025-08-01T16:09:19.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103102025-08-01T16:09:19.769ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
103112025-08-01T16:09:19.769ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
103122025-08-01T16:09:19.769ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
103132025-08-01T16:09:19.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
103142025-08-01T16:09:19.770ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103152025-08-01T16:09:19.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103162025-08-01T16:09:19.773ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44255, tv_nsec: 790144064 } })
103172025-08-01T16:09:19.773ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
103182025-08-01T16:09:19.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
103192025-08-01T16:09:19.774ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
103202025-08-01T16:09:19.774ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103212025-08-01T16:09:19.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
103222025-08-01T16:09:19.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103232025-08-01T16:09:19.775ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
103242025-08-01T16:09:19.775ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 17.47851ms iteration = 139 status = {"chicken_switches_updated":false}
103252025-08-01T16:09:19.776ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
103262025-08-01T16:09:19.776ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103272025-08-01T16:09:19.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
103282025-08-01T16:09:19.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103292025-08-01T16:09:19.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103302025-08-01T16:09:19.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103312025-08-01T16:09:19.776ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103322025-08-01T16:09:19.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103332025-08-01T16:09:19.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103342025-08-01T16:09:19.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103352025-08-01T16:09:19.778ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103362025-08-01T16:09:19.778ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
103372025-08-01T16:09:19.778ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103382025-08-01T16:09:19.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103392025-08-01T16:09:19.779ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
103402025-08-01T16:09:19.779ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 21.311846ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
103412025-08-01T16:09:19.780ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103422025-08-01T16:09:19.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
103432025-08-01T16:09:19.782ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
103442025-08-01T16:09:19.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103452025-08-01T16:09:19.785ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
103462025-08-01T16:09:19.785ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103472025-08-01T16:09:19.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103482025-08-01T16:09:19.803ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
103492025-08-01T16:09:19.803ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 44.245122ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
103502025-08-01T16:09:19.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 47.727417ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
103512025-08-01T16:09:19.810ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.510432ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
103522025-08-01T16:09:19.820ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
103532025-08-01T16:09:19.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
103542025-08-01T16:09:19.823ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103552025-08-01T16:09:19.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103562025-08-01T16:09:19.824ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 66.496116ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
103572025-08-01T16:09:19.825ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103582025-08-01T16:09:19.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103592025-08-01T16:09:19.830ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
103602025-08-01T16:09:19.830ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103612025-08-01T16:09:19.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
103622025-08-01T16:09:19.832ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
103632025-08-01T16:09:19.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
103642025-08-01T16:09:19.833ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
103652025-08-01T16:09:19.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
103662025-08-01T16:09:19.834ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 76.820379ms iteration = 24 status = {"errors":[],"requests_created_ok":[]}
103672025-08-01T16:09:19.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
103682025-08-01T16:09:19.835ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103692025-08-01T16:09:19.835ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103702025-08-01T16:09:19.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103712025-08-01T16:09:19.835ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103722025-08-01T16:09:19.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103732025-08-01T16:09:19.837ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 79.382806ms iteration = 24 status = 0
103742025-08-01T16:09:19.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
103752025-08-01T16:09:19.838ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
103762025-08-01T16:09:19.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
103772025-08-01T16:09:19.840ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
103782025-08-01T16:09:19.840ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
103792025-08-01T16:09:19.840ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
103802025-08-01T16:09:19.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
103812025-08-01T16:09:19.858ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103822025-08-01T16:09:19.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103832025-08-01T16:09:19.860ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103842025-08-01T16:09:19.862ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103852025-08-01T16:09:19.862ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103862025-08-01T16:09:19.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103872025-08-01T16:09:19.864ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103882025-08-01T16:09:19.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103892025-08-01T16:09:19.868ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103902025-08-01T16:09:19.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103912025-08-01T16:09:19.883ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
103922025-08-01T16:09:19.883ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103932025-08-01T16:09:19.884ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f59fa9b-ddc9-4ea3-a221-5a4ad1897488", "content-length": "26", "date": "Fri, 01 Aug 2025 16:09:19 GMT"} })
103942025-08-01T16:09:19.884ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103952025-08-01T16:09:19.885ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
103962025-08-01T16:09:19.895ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:391
103972025-08-01T16:09:19.895ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 136.006334ms iteration = 24 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
103982025-08-01T16:09:19.898ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 140.956464ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
103992025-08-01T16:09:19.899ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 141.656726ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104002025-08-01T16:09:19.900ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
104012025-08-01T16:09:19.900ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
104022025-08-01T16:09:19.900ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "20bc4927-5672-457e-9c72-05666cd10500", "content-length": "26", "date": "Fri, 01 Aug 2025 16:09:19 GMT"} })
104032025-08-01T16:09:19.900ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
104042025-08-01T16:09:19.903ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
104052025-08-01T16:09:19.909ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 151.497633ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
104062025-08-01T16:09:19.913ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
104072025-08-01T16:09:19.913ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
104082025-08-01T16:09:19.913ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 155.684361ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
104092025-08-01T16:09:19.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 579 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 66975241-de1c-46cf-9821-90ada902771c response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
104102025-08-01T16:09:19.963ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 zone_address = fd00:1122:3344:101::2
104112025-08-01T16:09:19.963ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
104122025-08-01T16:09:19.963ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfbb36d2-2f09-42c9-885a-b1bc50f8eb40", "content-length": "26", "date": "Fri, 01 Aug 2025 16:09:19 GMT"} })
104132025-08-01T16:09:19.963ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
104142025-08-01T16:09:19.965ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
104152025-08-01T16:09:19.966ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 208.699648ms iteration = 27 status = {"physical_disks_added":0}
104162025-08-01T16:09:20.019ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
104172025-08-01T16:09:20.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
104182025-08-01T16:09:20.022ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 334.545414ms iteration = 24 status = null
104192025-08-01T16:09:20.092ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
104202025-08-01T16:09:20.093ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "87976a1c-aa27-456d-8e72-8a100db3b3f5", "content-length": "691", "date": "Fri, 01 Aug 2025 16:09:19 GMT"} })
104212025-08-01T16:09:20.093ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
104222025-08-01T16:09:20.093ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
104232025-08-01T16:09:20.093ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
104242025-08-01T16:09:20.095ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 338.03949ms iteration = 24 status = {}
104252025-08-01T16:09:20.101ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 413.665803ms iteration = 24 status = {}
104262025-08-01T16:09:20.117ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
104272025-08-01T16:09:20.117ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
104282025-08-01T16:09:20.117ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e14a3a3f-fe6d-4903-9291-cd4cb26bddbd", "content-length": "372", "date": "Fri, 01 Aug 2025 16:09:19 GMT"} })
104292025-08-01T16:09:20.117ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104302025-08-01T16:09:20.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104312025-08-01T16:09:20.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104322025-08-01T16:09:20.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104332025-08-01T16:09:20.168ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
104342025-08-01T16:09:20.168ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
104352025-08-01T16:09:20.168ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 3f21d9d5-3adf-463a-a05d-bc2e2e5d64ca, rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(4c7da70d-ede0-4107-abc5-5650a053be38) } rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
104362025-08-01T16:09:20.168ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104372025-08-01T16:09:20.168ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9ea7a369-9991-4ef3-842c-4fff313b5bad", "date": "Fri, 01 Aug 2025 16:09:19 GMT"} })
104382025-08-01T16:09:20.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104392025-08-01T16:09:20.168ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104402025-08-01T16:09:20.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104412025-08-01T16:09:20.171ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104422025-08-01T16:09:20.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104432025-08-01T16:09:20.174ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104442025-08-01T16:09:20.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104452025-08-01T16:09:20.177ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
104462025-08-01T16:09:20.177ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
104472025-08-01T16:09:20.178ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9dc0ecd9-f3ed-4f12-940e-8c915913ea9d", "date": "Fri, 01 Aug 2025 16:09:19 GMT"} })
104482025-08-01T16:09:20.179ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 421.351436ms iteration = 24 status = {}
104492025-08-01T16:09:20.181ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
104502025-08-01T16:09:20.181ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 4c7da70d-ede0-4107-abc5-5650a053be38
104512025-08-01T16:09:20.181ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
104522025-08-01T16:09:20.181ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
104532025-08-01T16:09:20.181ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104542025-08-01T16:09:20.181ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104552025-08-01T16:09:20.181ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104562025-08-01T16:09:20.181ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
104572025-08-01T16:09:20.181ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104582025-08-01T16:09:20.181ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
104592025-08-01T16:09:20.182ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
104602025-08-01T16:09:20.182ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104612025-08-01T16:09:20.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104622025-08-01T16:09:20.184ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
104632025-08-01T16:09:20.184ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
104642025-08-01T16:09:20.294ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f4990550-2d4a-4d5a-a506-a2fa6fa9ca87", "date": "Fri, 01 Aug 2025 16:09:19 GMT"} })
104652025-08-01T16:09:20.294ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch = Switch0
104662025-08-01T16:09:20.294ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
104672025-08-01T16:09:20.294ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae9491ea-9a25-4d0b-901e-d46791685b39", "content-length": "682", "date": "Fri, 01 Aug 2025 16:09:19 GMT"} })
104682025-08-01T16:09:20.294ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104692025-08-01T16:09:20.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104702025-08-01T16:09:20.298ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104712025-08-01T16:09:20.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104722025-08-01T16:09:20.302ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104732025-08-01T16:09:20.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104742025-08-01T16:09:20.305ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104752025-08-01T16:09:20.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104762025-08-01T16:09:20.312ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 554.926266ms iteration = 24 status = {}
104772025-08-01T16:09:20.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 105dadcf-1054-4fc6-a4db-06e92a2f292d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
104782025-08-01T16:09:20.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 105dadcf-1054-4fc6-a4db-06e92a2f292d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
104792025-08-01T16:09:20.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2012 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 105dadcf-1054-4fc6-a4db-06e92a2f292d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
104802025-08-01T16:09:21.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d9f627b6-7966-4c9d-8840-8e2972b9d3bd roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
104812025-08-01T16:09:21.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d9f627b6-7966-4c9d-8840-8e2972b9d3bd resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
104822025-08-01T16:09:21.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2083 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d9f627b6-7966-4c9d-8840-8e2972b9d3bd response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
104832025-08-01T16:09:22.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ff5fe9a2-4f19-4bcb-9ee7-b2d380514e83 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
104842025-08-01T16:09:22.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ff5fe9a2-4f19-4bcb-9ee7-b2d380514e83 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
104852025-08-01T16:09:22.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2448 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ff5fe9a2-4f19-4bcb-9ee7-b2d380514e83 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
104862025-08-01T16:09:23.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c1ae76b4-a854-4794-88c8-39fb1e34b064 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
104872025-08-01T16:09:23.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c1ae76b4-a854-4794-88c8-39fb1e34b064 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
104882025-08-01T16:09:23.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2477 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c1ae76b4-a854-4794-88c8-39fb1e34b064 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
104892025-08-01T16:09:24.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 29726cea-50a7-4af5-9ac0-fd54c3016fd8 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
104902025-08-01T16:09:24.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 29726cea-50a7-4af5-9ac0-fd54c3016fd8 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
104912025-08-01T16:09:24.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2796 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 29726cea-50a7-4af5-9ac0-fd54c3016fd8 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
104922025-08-01T16:09:24.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 140 reason = Timeout
104932025-08-01T16:09:24.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
104942025-08-01T16:09:24.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
104952025-08-01T16:09:24.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104962025-08-01T16:09:24.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
104972025-08-01T16:09:24.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
104982025-08-01T16:09:24.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
104992025-08-01T16:09:24.764ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
105002025-08-01T16:09:24.764ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.329492ms iteration = 140 status = {"chicken_switches_updated":false}
105012025-08-01T16:09:25.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6c57fd75-0276-48bc-bb87-29820be94ca2 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105022025-08-01T16:09:25.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6c57fd75-0276-48bc-bb87-29820be94ca2 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105032025-08-01T16:09:25.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1857 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6c57fd75-0276-48bc-bb87-29820be94ca2 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105042025-08-01T16:09:26.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ef38d72c-d23f-4694-9bb7-d7ae0be2c113 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105052025-08-01T16:09:26.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ef38d72c-d23f-4694-9bb7-d7ae0be2c113 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105062025-08-01T16:09:26.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2259 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ef38d72c-d23f-4694-9bb7-d7ae0be2c113 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105072025-08-01T16:09:27.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a42a9f80-1bb1-486a-87b5-c41b962ca171 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105082025-08-01T16:09:27.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a42a9f80-1bb1-486a-87b5-c41b962ca171 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105092025-08-01T16:09:27.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2203 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a42a9f80-1bb1-486a-87b5-c41b962ca171 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105102025-08-01T16:09:28.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0ee882d2-06ba-4efc-b8f6-72bd904dfe5e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105112025-08-01T16:09:28.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0ee882d2-06ba-4efc-b8f6-72bd904dfe5e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105122025-08-01T16:09:28.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2162 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0ee882d2-06ba-4efc-b8f6-72bd904dfe5e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105132025-08-01T16:09:29.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9f10363d-73fb-40d2-ad48-47e63dc82c43 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105142025-08-01T16:09:29.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9f10363d-73fb-40d2-ad48-47e63dc82c43 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105152025-08-01T16:09:29.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2462 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9f10363d-73fb-40d2-ad48-47e63dc82c43 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105162025-08-01T16:09:29.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
105172025-08-01T16:09:29.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 141 reason = Timeout
105182025-08-01T16:09:29.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105192025-08-01T16:09:29.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
105202025-08-01T16:09:29.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
105212025-08-01T16:09:29.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105222025-08-01T16:09:29.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
105232025-08-01T16:09:29.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105242025-08-01T16:09:29.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105252025-08-01T16:09:29.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105262025-08-01T16:09:29.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105272025-08-01T16:09:29.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105282025-08-01T16:09:29.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105292025-08-01T16:09:29.763ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.731453ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
105302025-08-01T16:09:29.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
105312025-08-01T16:09:29.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
105322025-08-01T16:09:29.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
105332025-08-01T16:09:29.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
105342025-08-01T16:09:29.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105352025-08-01T16:09:29.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105362025-08-01T16:09:29.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
105372025-08-01T16:09:29.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.764295ms iteration = 141 status = {"chicken_switches_updated":false}
105382025-08-01T16:09:29.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105392025-08-01T16:09:29.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105402025-08-01T16:09:29.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105412025-08-01T16:09:29.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
105422025-08-01T16:09:29.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105432025-08-01T16:09:29.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105442025-08-01T16:09:29.788ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
105452025-08-01T16:09:29.788ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.732861ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
105462025-08-01T16:09:29.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = 58bc55b5-fd2c-478f-b863-7430d8b4ed89 roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
105472025-08-01T16:09:29.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = 58bc55b5-fd2c-478f-b863-7430d8b4ed89 resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
105482025-08-01T16:09:29.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2416 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = 58bc55b5-fd2c-478f-b863-7430d8b4ed89 response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
105492025-08-01T16:09:29.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = aed61de3-b758-434c-b285-e35e099d116f roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
105502025-08-01T16:09:29.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = aed61de3-b758-434c-b285-e35e099d116f resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
105512025-08-01T16:09:29.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1689 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = aed61de3-b758-434c-b285-e35e099d116f response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
105522025-08-01T16:09:29.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 518 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = c667ce1d-5c65-45b5-aa27-0ed10f24a45a response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
105532025-08-01T16:09:30.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 53436eda-9472-43b6-ac6e-ddbdda2cd9c5 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105542025-08-01T16:09:30.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 53436eda-9472-43b6-ac6e-ddbdda2cd9c5 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105552025-08-01T16:09:30.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2393 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 53436eda-9472-43b6-ac6e-ddbdda2cd9c5 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105562025-08-01T16:09:31.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8b966fab-ab70-42d7-93ca-0c35425136ef roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105572025-08-01T16:09:31.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8b966fab-ab70-42d7-93ca-0c35425136ef resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105582025-08-01T16:09:31.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2362 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8b966fab-ab70-42d7-93ca-0c35425136ef response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105592025-08-01T16:09:32.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8f37e7c7-5bf7-4549-a015-55131ea1b29b roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105602025-08-01T16:09:32.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8f37e7c7-5bf7-4549-a015-55131ea1b29b resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105612025-08-01T16:09:32.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2249 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8f37e7c7-5bf7-4549-a015-55131ea1b29b response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105622025-08-01T16:09:33.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ea2c5eb3-a33a-4ae2-8058-e8c6861cef40 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105632025-08-01T16:09:33.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ea2c5eb3-a33a-4ae2-8058-e8c6861cef40 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105642025-08-01T16:09:33.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1833 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ea2c5eb3-a33a-4ae2-8058-e8c6861cef40 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105652025-08-01T16:09:34.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 142 reason = Timeout
105662025-08-01T16:09:34.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
105672025-08-01T16:09:34.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
105682025-08-01T16:09:34.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105692025-08-01T16:09:34.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
105702025-08-01T16:09:34.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
105712025-08-01T16:09:34.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
105722025-08-01T16:09:34.764ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
105732025-08-01T16:09:34.764ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.584119ms iteration = 142 status = {"chicken_switches_updated":false}
105742025-08-01T16:09:34.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b0bb036d-e55e-4189-9edb-384a95000318 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105752025-08-01T16:09:34.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b0bb036d-e55e-4189-9edb-384a95000318 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105762025-08-01T16:09:34.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1989 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b0bb036d-e55e-4189-9edb-384a95000318 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105772025-08-01T16:09:35.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 060a79bb-b81f-4016-99cf-260a1dcbc670 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105782025-08-01T16:09:35.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 060a79bb-b81f-4016-99cf-260a1dcbc670 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105792025-08-01T16:09:35.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2202 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 060a79bb-b81f-4016-99cf-260a1dcbc670 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105802025-08-01T16:09:36.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8564a8ee-22a7-4cc2-907a-2c1800e64ee9 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105812025-08-01T16:09:36.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8564a8ee-22a7-4cc2-907a-2c1800e64ee9 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105822025-08-01T16:09:36.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2403 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8564a8ee-22a7-4cc2-907a-2c1800e64ee9 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105832025-08-01T16:09:37.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0dafbf72-e1dd-4d4f-82e5-f685c0c50730 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105842025-08-01T16:09:37.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0dafbf72-e1dd-4d4f-82e5-f685c0c50730 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105852025-08-01T16:09:37.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2432 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0dafbf72-e1dd-4d4f-82e5-f685c0c50730 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105862025-08-01T16:09:38.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3681beaa-77c5-4f76-a5b1-7425dc1144f5 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105872025-08-01T16:09:38.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3681beaa-77c5-4f76-a5b1-7425dc1144f5 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105882025-08-01T16:09:38.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2058 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3681beaa-77c5-4f76-a5b1-7425dc1144f5 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
105892025-08-01T16:09:39.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
105902025-08-01T16:09:39.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105912025-08-01T16:09:39.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 143 reason = Timeout
105922025-08-01T16:09:39.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
105932025-08-01T16:09:39.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
105942025-08-01T16:09:39.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105952025-08-01T16:09:39.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
105962025-08-01T16:09:39.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105972025-08-01T16:09:39.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105982025-08-01T16:09:39.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105992025-08-01T16:09:39.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106002025-08-01T16:09:39.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106012025-08-01T16:09:39.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106022025-08-01T16:09:39.761ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.815195ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
106032025-08-01T16:09:39.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
106042025-08-01T16:09:39.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
106052025-08-01T16:09:39.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
106062025-08-01T16:09:39.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
106072025-08-01T16:09:39.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106082025-08-01T16:09:39.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106092025-08-01T16:09:39.764ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
106102025-08-01T16:09:39.764ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.58025ms iteration = 143 status = {"chicken_switches_updated":false}
106112025-08-01T16:09:39.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106122025-08-01T16:09:39.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106132025-08-01T16:09:39.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106142025-08-01T16:09:39.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
106152025-08-01T16:09:39.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106162025-08-01T16:09:39.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106172025-08-01T16:09:39.787ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
106182025-08-01T16:09:39.787ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.677029ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
106192025-08-01T16:09:39.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9266e27e-4586-4414-b4f3-c10818c149e8 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106202025-08-01T16:09:39.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9266e27e-4586-4414-b4f3-c10818c149e8 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106212025-08-01T16:09:39.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1905 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9266e27e-4586-4414-b4f3-c10818c149e8 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106222025-08-01T16:09:39.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 595 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = ce8f1cc4-a19a-4fb5-912f-001410725222 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
106232025-08-01T16:09:40.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d14c232a-4942-4117-ad97-89f09fe7f419 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106242025-08-01T16:09:40.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d14c232a-4942-4117-ad97-89f09fe7f419 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106252025-08-01T16:09:40.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2085 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d14c232a-4942-4117-ad97-89f09fe7f419 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106262025-08-01T16:09:41.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 325482cb-193c-4784-bfe1-91847a20117d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106272025-08-01T16:09:41.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 325482cb-193c-4784-bfe1-91847a20117d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106282025-08-01T16:09:41.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2732 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 325482cb-193c-4784-bfe1-91847a20117d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106292025-08-01T16:09:42.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b3a0bb32-2047-4749-8e8b-da2d2ccf4cde roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106302025-08-01T16:09:42.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b3a0bb32-2047-4749-8e8b-da2d2ccf4cde resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106312025-08-01T16:09:42.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2060 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b3a0bb32-2047-4749-8e8b-da2d2ccf4cde response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106322025-08-01T16:09:43.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f2b45d85-dacf-4fc0-aa29-16da317f713e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106332025-08-01T16:09:43.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f2b45d85-dacf-4fc0-aa29-16da317f713e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106342025-08-01T16:09:43.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2122 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f2b45d85-dacf-4fc0-aa29-16da317f713e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106352025-08-01T16:09:44.757ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 144 reason = Timeout
106362025-08-01T16:09:44.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
106372025-08-01T16:09:44.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
106382025-08-01T16:09:44.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106392025-08-01T16:09:44.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
106402025-08-01T16:09:44.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
106412025-08-01T16:09:44.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
106422025-08-01T16:09:44.763ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
106432025-08-01T16:09:44.763ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.018262ms iteration = 144 status = {"chicken_switches_updated":false}
106442025-08-01T16:09:44.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6702f211-bd47-4f74-bb98-852983dc709c roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106452025-08-01T16:09:44.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6702f211-bd47-4f74-bb98-852983dc709c resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106462025-08-01T16:09:44.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2473 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6702f211-bd47-4f74-bb98-852983dc709c response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106472025-08-01T16:09:46.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6e6794f9-7046-40e6-8589-57c31e2dae4e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106482025-08-01T16:09:46.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6e6794f9-7046-40e6-8589-57c31e2dae4e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106492025-08-01T16:09:46.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2171 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6e6794f9-7046-40e6-8589-57c31e2dae4e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106502025-08-01T16:09:47.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b310511a-c470-4a31-acc4-7ec85c3850a7 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106512025-08-01T16:09:47.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b310511a-c470-4a31-acc4-7ec85c3850a7 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106522025-08-01T16:09:47.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1834 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b310511a-c470-4a31-acc4-7ec85c3850a7 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106532025-08-01T16:09:48.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 381dde31-3a85-4710-89b3-ea406d9f8ad8 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106542025-08-01T16:09:48.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 381dde31-3a85-4710-89b3-ea406d9f8ad8 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106552025-08-01T16:09:48.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2458 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 381dde31-3a85-4710-89b3-ea406d9f8ad8 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106562025-08-01T16:09:49.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = eb641045-9e7d-4a0e-b127-5c80471d6a87 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106572025-08-01T16:09:49.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = eb641045-9e7d-4a0e-b127-5c80471d6a87 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106582025-08-01T16:09:49.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2125 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = eb641045-9e7d-4a0e-b127-5c80471d6a87 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
106592025-08-01T16:09:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
106602025-08-01T16:09:49.687ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
106612025-08-01T16:09:49.687ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106622025-08-01T16:09:49.687ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
106632025-08-01T16:09:49.687ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
106642025-08-01T16:09:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
106652025-08-01T16:09:49.687ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
106662025-08-01T16:09:49.687ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
106672025-08-01T16:09:49.687ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-01 15:59:49.687202270 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
106682025-08-01T16:09:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
106692025-08-01T16:09:49.687ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
106702025-08-01T16:09:49.687ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
106712025-08-01T16:09:49.687ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
106722025-08-01T16:09:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
106732025-08-01T16:09:49.687ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
106742025-08-01T16:09:49.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106752025-08-01T16:09:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
106762025-08-01T16:09:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
106772025-08-01T16:09:49.687ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
106782025-08-01T16:09:49.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
106792025-08-01T16:09:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106802025-08-01T16:09:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
106812025-08-01T16:09:49.687ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cb706a84-a33b-442f-aac2-3a6eb5f3b330.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d688a68d-d771-4ac5-8e66-9efa94dbbea8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d688a68d-d771-4ac5-8e66-9efa94dbbea8.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 44285, tv_nsec: 704556491 } })
106822025-08-01T16:09:49.687ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50fe31de-3241-42df-a386-de37ce323a34.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("58598327-8751-423c-a5ac-c610829651e2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 44285, tv_nsec: 704557001 } })
106832025-08-01T16:09:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
106842025-08-01T16:09:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106852025-08-01T16:09:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
106862025-08-01T16:09:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106872025-08-01T16:09:49.688ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
106882025-08-01T16:09:49.688ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.268348ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
106892025-08-01T16:09:49.688ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
106902025-08-01T16:09:49.688ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.265728ms iteration = 13 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
106912025-08-01T16:09:49.690ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106922025-08-01T16:09:49.690ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106932025-08-01T16:09:49.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106942025-08-01T16:09:49.691ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44285, tv_nsec: 708164741 } })
106952025-08-01T16:09:49.691ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
106962025-08-01T16:09:49.691ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44285, tv_nsec: 708385717 } })
106972025-08-01T16:09:49.691ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
106982025-08-01T16:09:49.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106992025-08-01T16:09:49.691ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
107002025-08-01T16:09:49.691ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.769065ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
107012025-08-01T16:09:49.692ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
107022025-08-01T16:09:49.692ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107032025-08-01T16:09:49.692ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-01 15:59:49.687202270 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
107042025-08-01T16:09:49.692ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.766055ms iteration = 13 status = {"expiration":"2025-08-01T15:59:49.687202270Z","pruned":[]}
107052025-08-01T16:09:49.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107062025-08-01T16:09:49.693ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107072025-08-01T16:09:49.693ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107082025-08-01T16:09:49.695ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107092025-08-01T16:09:49.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107102025-08-01T16:09:49.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
107112025-08-01T16:09:49.697ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107122025-08-01T16:09:49.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
107132025-08-01T16:09:49.700ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
107142025-08-01T16:09:49.700ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
107152025-08-01T16:09:49.700ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
107162025-08-01T16:09:49.700ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107172025-08-01T16:09:49.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107182025-08-01T16:09:49.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
107192025-08-01T16:09:49.702ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107202025-08-01T16:09:49.703ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107212025-08-01T16:09:49.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107222025-08-01T16:09:49.705ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
107232025-08-01T16:09:49.705ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1
107242025-08-01T16:09:49.705ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.331\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1"}
107252025-08-01T16:09:49.706ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
107262025-08-01T16:09:49.706ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107272025-08-01T16:09:49.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107282025-08-01T16:09:49.709ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
107292025-08-01T16:09:49.709ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 17 reason = Timeout
107302025-08-01T16:09:49.709ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
107312025-08-01T16:09:49.709ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 11.13\u{b5}s iteration = 17 status = "Disabled"
107322025-08-01T16:09:49.709ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
107332025-08-01T16:09:49.709ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
107342025-08-01T16:09:49.709ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6482e44c-c860-4033-b945-5707d343a59d dns_zone_name = oxide.test found_so_far = 0 version = 2
107352025-08-01T16:09:49.709ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107362025-08-01T16:09:49.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
107372025-08-01T16:09:49.709ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
107382025-08-01T16:09:49.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107392025-08-01T16:09:49.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
107402025-08-01T16:09:49.709ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
107412025-08-01T16:09:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
107422025-08-01T16:09:49.710ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
107432025-08-01T16:09:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
107442025-08-01T16:09:49.710ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
107452025-08-01T16:09:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
107462025-08-01T16:09:49.710ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
107472025-08-01T16:09:49.710ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
107482025-08-01T16:09:49.710ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 13 reason = Timeout
107492025-08-01T16:09:49.710ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
107502025-08-01T16:09:49.710ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
107512025-08-01T16:09:49.710ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
107522025-08-01T16:09:49.710ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
107532025-08-01T16:09:49.710ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
107542025-08-01T16:09:49.710ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
107552025-08-01T16:09:49.710ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 13 reason = Timeout
107562025-08-01T16:09:49.710ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
107572025-08-01T16:09:49.710ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
107582025-08-01T16:09:49.710ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
107592025-08-01T16:09:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
107602025-08-01T16:09:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
107612025-08-01T16:09:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
107622025-08-01T16:09:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
107632025-08-01T16:09:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
107642025-08-01T16:09:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
107652025-08-01T16:09:49.711ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107662025-08-01T16:09:49.711ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107672025-08-01T16:09:49.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
107682025-08-01T16:09:49.715ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
107692025-08-01T16:09:49.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
107702025-08-01T16:09:49.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
107712025-08-01T16:09:49.717ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107722025-08-01T16:09:49.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107732025-08-01T16:09:49.719ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107742025-08-01T16:09:49.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
107752025-08-01T16:09:49.722ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
107762025-08-01T16:09:49.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
107772025-08-01T16:09:49.722ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107782025-08-01T16:09:49.724ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
107792025-08-01T16:09:49.724ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
107802025-08-01T16:09:49.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
107812025-08-01T16:09:49.725ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107822025-08-01T16:09:49.725ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
107832025-08-01T16:09:49.725ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 14.644735ms iteration = 13 status = {"by_rx":{},"error":null}
107842025-08-01T16:09:49.725ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107852025-08-01T16:09:49.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
107862025-08-01T16:09:49.729ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
107872025-08-01T16:09:49.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
107882025-08-01T16:09:49.729ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107892025-08-01T16:09:49.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
107902025-08-01T16:09:49.729ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
107912025-08-01T16:09:49.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
107922025-08-01T16:09:49.731ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
107932025-08-01T16:09:49.731ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
107942025-08-01T16:09:49.731ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 20.729419ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
107952025-08-01T16:09:49.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
107962025-08-01T16:09:49.732ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
107972025-08-01T16:09:49.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
107982025-08-01T16:09:49.738ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6482e44c-c860-4033-b945-5707d343a59d dns_zone_name = oxide.test found_so_far = 4 version = 2
107992025-08-01T16:09:49.738ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
108002025-08-01T16:09:49.738ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-01 15:58:34.713515 UTC dns_group = external generation = 2
108012025-08-01T16:09:49.738ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 51.12556ms iteration = 13 status = {"generation":2}
108022025-08-01T16:09:49.739ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
108032025-08-01T16:09:49.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
108042025-08-01T16:09:49.741ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 32.432194ms iteration = 6 status = {"nsuccess":5}
108052025-08-01T16:09:49.742ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 31.716672ms iteration = 13 status = {"dispatched":[],"errors":[],"glob_version":"173.0.0","globs_reprocessed":{},"no_receivers":[]}
108062025-08-01T16:09:49.755ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
108072025-08-01T16:09:49.755ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
108082025-08-01T16:09:49.755ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
108092025-08-01T16:09:49.755ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
108102025-08-01T16:09:49.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
108112025-08-01T16:09:49.757ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108122025-08-01T16:09:49.758ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
108132025-08-01T16:09:49.758ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
108142025-08-01T16:09:49.758ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 25 reason = Timeout
108152025-08-01T16:09:49.758ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
108162025-08-01T16:09:49.758ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108172025-08-01T16:09:49.758ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
108182025-08-01T16:09:49.758ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108192025-08-01T16:09:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
108202025-08-01T16:09:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
108212025-08-01T16:09:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
108222025-08-01T16:09:49.758ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
108232025-08-01T16:09:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
108242025-08-01T16:09:49.758ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
108252025-08-01T16:09:49.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108262025-08-01T16:09:49.758ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
108272025-08-01T16:09:49.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
108282025-08-01T16:09:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
108292025-08-01T16:09:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108302025-08-01T16:09:49.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 145 reason = Timeout
108312025-08-01T16:09:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
108322025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
108332025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
108342025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
108352025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108362025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
108372025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
108382025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
108392025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
108402025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 25 reason = Timeout
108412025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 12.19\u{b5}s iteration = 25 status = {"disabled":true,"errors":[],"sps":[]}
108422025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
108432025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
108442025-08-01T16:09:49.759ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
108452025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108462025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
108472025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 25 reason = Timeout
108482025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
108492025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
108502025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108512025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108522025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
108532025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108542025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
108552025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108562025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
108572025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108582025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108592025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
108602025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
108612025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
108622025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
108632025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
108642025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108652025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
108662025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
108672025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108682025-08-01T16:09:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
108692025-08-01T16:09:49.760ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108702025-08-01T16:09:49.761ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
108712025-08-01T16:09:49.761ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
108722025-08-01T16:09:49.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
108732025-08-01T16:09:49.762ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108742025-08-01T16:09:49.763ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108752025-08-01T16:09:49.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
108762025-08-01T16:09:49.764ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108772025-08-01T16:09:49.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108782025-08-01T16:09:49.765ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.197518ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
108792025-08-01T16:09:49.765ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
108802025-08-01T16:09:49.765ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
108812025-08-01T16:09:49.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
108822025-08-01T16:09:49.766ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108832025-08-01T16:09:49.766ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
108842025-08-01T16:09:49.766ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
108852025-08-01T16:09:49.766ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
108862025-08-01T16:09:49.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
108872025-08-01T16:09:49.767ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108882025-08-01T16:09:49.767ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108892025-08-01T16:09:49.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108902025-08-01T16:09:49.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
108912025-08-01T16:09:49.768ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108922025-08-01T16:09:49.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108932025-08-01T16:09:49.770ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108942025-08-01T16:09:49.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108952025-08-01T16:09:49.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
108962025-08-01T16:09:49.771ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108972025-08-01T16:09:49.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108982025-08-01T16:09:49.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
108992025-08-01T16:09:49.772ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
109002025-08-01T16:09:49.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
109012025-08-01T16:09:49.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
109022025-08-01T16:09:49.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109032025-08-01T16:09:49.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109042025-08-01T16:09:49.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
109052025-08-01T16:09:49.774ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
109062025-08-01T16:09:49.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
109072025-08-01T16:09:49.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109082025-08-01T16:09:49.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109092025-08-01T16:09:49.778ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
109102025-08-01T16:09:49.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
109112025-08-01T16:09:49.779ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44285, tv_nsec: 796134358 } })
109122025-08-01T16:09:49.780ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
109132025-08-01T16:09:49.781ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
109142025-08-01T16:09:49.781ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 22.324857ms iteration = 145 status = {"chicken_switches_updated":false}
109152025-08-01T16:09:49.781ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109162025-08-01T16:09:49.783ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109172025-08-01T16:09:49.787ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
109182025-08-01T16:09:49.787ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109192025-08-01T16:09:49.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109202025-08-01T16:09:49.787ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
109212025-08-01T16:09:49.787ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
109222025-08-01T16:09:49.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
109232025-08-01T16:09:49.801ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
109242025-08-01T16:09:49.801ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
109252025-08-01T16:09:49.801ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 90.445802ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
109262025-08-01T16:09:49.814ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
109272025-08-01T16:09:49.814ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.199474ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
109282025-08-01T16:09:49.835ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
109292025-08-01T16:09:49.835ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
109302025-08-01T16:09:49.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
109312025-08-01T16:09:49.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
109322025-08-01T16:09:49.842ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 83.144131ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
109332025-08-01T16:09:49.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
109342025-08-01T16:09:49.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109352025-08-01T16:09:49.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
109362025-08-01T16:09:49.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109372025-08-01T16:09:49.844ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
109382025-08-01T16:09:49.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109392025-08-01T16:09:49.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109402025-08-01T16:09:49.845ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
109412025-08-01T16:09:49.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
109422025-08-01T16:09:49.846ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 87.415901ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
109432025-08-01T16:09:49.847ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109442025-08-01T16:09:49.847ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 88.368799ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
109452025-08-01T16:09:49.847ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 89.0318ms iteration = 25 status = {"errors":[],"requests_created_ok":[]}
109462025-08-01T16:09:49.848ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109472025-08-01T16:09:49.850ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
109482025-08-01T16:09:49.850ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109492025-08-01T16:09:49.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109502025-08-01T16:09:49.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109512025-08-01T16:09:49.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
109522025-08-01T16:09:49.852ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
109532025-08-01T16:09:49.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
109542025-08-01T16:09:49.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109552025-08-01T16:09:49.855ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
109562025-08-01T16:09:49.855ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
109572025-08-01T16:09:49.855ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "94e159e6-545d-420d-a14f-4e0c1dd8bfec", "content-length": "26", "date": "Fri, 01 Aug 2025 16:09:49 GMT"} })
109582025-08-01T16:09:49.855ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
109592025-08-01T16:09:49.856ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
109602025-08-01T16:09:49.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109612025-08-01T16:09:49.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
109622025-08-01T16:09:49.856ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
109632025-08-01T16:09:49.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109642025-08-01T16:09:49.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
109652025-08-01T16:09:49.859ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
109662025-08-01T16:09:49.870ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
109672025-08-01T16:09:49.870ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 02fcb774-aa43-4052-9996-b85e2d1358b5 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
109682025-08-01T16:09:49.870ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
109692025-08-01T16:09:49.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
109702025-08-01T16:09:49.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109712025-08-01T16:09:49.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109722025-08-01T16:09:49.875ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109732025-08-01T16:09:49.876ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109742025-08-01T16:09:49.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109752025-08-01T16:09:49.877ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
109762025-08-01T16:09:49.877ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 118.322228ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
109772025-08-01T16:09:49.879ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109782025-08-01T16:09:49.880ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109792025-08-01T16:09:49.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109802025-08-01T16:09:49.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
109812025-08-01T16:09:49.881ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
109822025-08-01T16:09:49.881ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
109832025-08-01T16:09:49.881ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
109842025-08-01T16:09:49.881ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
109852025-08-01T16:09:49.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
109862025-08-01T16:09:49.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
109872025-08-01T16:09:49.883ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
109882025-08-01T16:09:49.883ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109892025-08-01T16:09:49.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
109902025-08-01T16:09:49.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
109912025-08-01T16:09:49.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109922025-08-01T16:09:49.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109932025-08-01T16:09:49.884ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 02fcb774-aa43-4052-9996-b85e2d1358b5 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
109942025-08-01T16:09:49.884ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
109952025-08-01T16:09:49.884ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-01 15:58:34.032744 UTC dns_group = internal generation = 1
109962025-08-01T16:09:49.884ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 197.583851ms iteration = 13 status = {"generation":1}
109972025-08-01T16:09:49.887ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
109982025-08-01T16:09:49.887ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109992025-08-01T16:09:49.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110002025-08-01T16:09:49.888ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 129.28142ms iteration = 25 status = 0
110012025-08-01T16:09:49.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110022025-08-01T16:09:49.892ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
110032025-08-01T16:09:49.892ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110042025-08-01T16:09:49.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110052025-08-01T16:09:49.897ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
110062025-08-01T16:09:49.898ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-01T15:57:44.766264Z, time_modified: 2025-08-01T15:57:44.766264Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: eec17da7-eb17-4917-8728-908698b69bbe, db_silo: Silo { identity: SiloIdentity { id: eec17da7-eb17-4917-8728-908698b69bbe, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-01T15:58:34.653875Z, time_modified: 2025-08-01T15:58:34.653875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: eec17da7-eb17-4917-8728-908698b69bbe, db_silo: Silo { identity: SiloIdentity { id: eec17da7-eb17-4917-8728-908698b69bbe, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-01T15:58:34.653875Z, time_modified: 2025-08-01T15:58:34.653875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
110072025-08-01T16:09:49.898ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 211.07821ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"eec17da7-eb17-4917-8728-908698b69bbe","tls_certs":["b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575"]}},"default_endpoint":{"silo_id":"eec17da7-eb17-4917-8728-908698b69bbe","tls_certs":["b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
110082025-08-01T16:09:49.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 149.105252ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
110092025-08-01T16:09:49.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 970 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = bebb3dc7-f552-4dfe-9231-d89a2032f5e2 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
110102025-08-01T16:09:49.934ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
110112025-08-01T16:09:49.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
110122025-08-01T16:09:49.943ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:391
110132025-08-01T16:09:49.943ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 184.228446ms iteration = 25 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
110142025-08-01T16:09:49.950ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 191.353572ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
110152025-08-01T16:09:49.952ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
110162025-08-01T16:09:49.952ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
110172025-08-01T16:09:49.952ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 193.520337ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
110182025-08-01T16:09:49.960ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
110192025-08-01T16:09:49.960ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
110202025-08-01T16:09:49.961ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "53ba4be2-286b-46c4-91b3-6ccd6ef74417", "content-length": "26", "date": "Fri, 01 Aug 2025 16:09:49 GMT"} })
110212025-08-01T16:09:49.961ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
110222025-08-01T16:09:49.962ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
110232025-08-01T16:09:50.005ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 246.988779ms iteration = 28 status = {"physical_disks_added":0}
110242025-08-01T16:09:50.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 17dd5757-5ec2-45aa-a497-62d098a6ec7e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
110252025-08-01T16:09:50.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 17dd5757-5ec2-45aa-a497-62d098a6ec7e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
110262025-08-01T16:09:50.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3415 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 17dd5757-5ec2-45aa-a497-62d098a6ec7e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
110272025-08-01T16:09:50.105ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
110282025-08-01T16:09:50.106ZINFOnexus (BackgroundTasks): set region 8acfdaca-6992-464d-93d8-e5756d6f4ef8 port as 19003 background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:127
110292025-08-01T16:09:50.138ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
110302025-08-01T16:09:50.139ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 428.315687ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
110312025-08-01T16:09:50.183ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 zone_address = fd00:1122:3344:101::2
110322025-08-01T16:09:50.183ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
110332025-08-01T16:09:50.184ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "02b5d38c-dd82-4d9b-b417-7be4b7ad93b5", "content-length": "26", "date": "Fri, 01 Aug 2025 16:09:49 GMT"} })
110342025-08-01T16:09:50.184ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
110352025-08-01T16:09:50.186ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
110362025-08-01T16:09:50.200ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 513.5173ms iteration = 25 status = {}
110372025-08-01T16:09:50.233ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
110382025-08-01T16:09:50.233ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
110392025-08-01T16:09:50.233ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a55d33e3-7bf9-450b-8352-3bab58b008a0", "content-length": "372", "date": "Fri, 01 Aug 2025 16:09:50 GMT"} })
110402025-08-01T16:09:50.233ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110412025-08-01T16:09:50.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110422025-08-01T16:09:50.304ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
110432025-08-01T16:09:50.304ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
110442025-08-01T16:09:50.305ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d44990a3-29c0-41e7-a493-47caca87b22f", "date": "Fri, 01 Aug 2025 16:09:50 GMT"} })
110452025-08-01T16:09:50.305ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110462025-08-01T16:09:50.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110472025-08-01T16:09:50.309ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110482025-08-01T16:09:50.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110492025-08-01T16:09:50.313ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110502025-08-01T16:09:50.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110512025-08-01T16:09:50.317ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
110522025-08-01T16:09:50.318ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
110532025-08-01T16:09:50.318ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5a64002b-5fc3-4b12-bda3-1c48113f0e50", "date": "Fri, 01 Aug 2025 16:09:50 GMT"} })
110542025-08-01T16:09:50.320ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 561.238847ms iteration = 25 status = {}
110552025-08-01T16:09:50.323ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
110562025-08-01T16:09:50.323ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d90b6eb1-f5d9-4f5c-81aa-66e4469271e3", "date": "Fri, 01 Aug 2025 16:09:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
110572025-08-01T16:09:50.323ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
110582025-08-01T16:09:50.325ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "69d45cf4-6cd0-4a6b-a1e2-b3acee96958f", "date": "Fri, 01 Aug 2025 16:09:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
110592025-08-01T16:09:50.325ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
110602025-08-01T16:09:50.327ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
110612025-08-01T16:09:50.327ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 640.691716ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
110622025-08-01T16:09:50.337ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
110632025-08-01T16:09:50.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
110642025-08-01T16:09:50.339ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 652.457553ms iteration = 25 status = null
110652025-08-01T16:09:50.341ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
110662025-08-01T16:09:50.341ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9bebdd4-ee76-45e5-b5e2-d0edd88fc0bf", "content-length": "691", "date": "Fri, 01 Aug 2025 16:09:50 GMT"} })
110672025-08-01T16:09:50.341ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
110682025-08-01T16:09:50.341ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
110692025-08-01T16:09:50.342ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
110702025-08-01T16:09:50.343ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 584.546554ms iteration = 25 status = {}
110712025-08-01T16:09:50.395ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
110722025-08-01T16:09:50.395ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "19a96799-5a06-411f-91b9-204615b8ebf6", "date": "Fri, 01 Aug 2025 16:09:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
110732025-08-01T16:09:50.395ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
110742025-08-01T16:09:50.397ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b345fbc3-1052-4cc9-a42f-735713d6000e", "date": "Fri, 01 Aug 2025 16:09:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
110752025-08-01T16:09:50.397ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
110762025-08-01T16:09:50.398ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d8e4d7f6-1a5b-411e-9069-1a657381a65a", "date": "Fri, 01 Aug 2025 16:09:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
110772025-08-01T16:09:50.398ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
110782025-08-01T16:09:50.400ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
110792025-08-01T16:09:50.400ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 713.529535ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
110802025-08-01T16:09:50.403ZINFOnexus (BackgroundTasks): set region a30aae84-b3c2-488a-b5f1-08addae06489 port as 19002 background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:127
110812025-08-01T16:09:50.478ZINFOnexus (BackgroundTasks): set region ae9e56bf-9719-40ce-a993-de165fa62c33 port as 19000 background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:127
110822025-08-01T16:09:50.478ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 768.350317ms iteration = 13 status = {"errors":[],"found_port_ok":["set region 8acfdaca-6992-464d-93d8-e5756d6f4ef8 port as 19003","set region a30aae84-b3c2-488a-b5f1-08addae06489 port as 19002","set region ae9e56bf-9719-40ce-a993-de165fa62c33 port as 19000"]}
110832025-08-01T16:09:50.486ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110842025-08-01T16:09:50.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110852025-08-01T16:09:50.489ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 3f21d9d5-3adf-463a-a05d-bc2e2e5d64ca, rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(4c7da70d-ede0-4107-abc5-5650a053be38) } rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
110862025-08-01T16:09:50.489ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110872025-08-01T16:09:50.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110882025-08-01T16:09:50.499ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
110892025-08-01T16:09:50.499ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 4c7da70d-ede0-4107-abc5-5650a053be38
110902025-08-01T16:09:50.499ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
110912025-08-01T16:09:50.499ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
110922025-08-01T16:09:50.499ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
110932025-08-01T16:09:50.499ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
110942025-08-01T16:09:50.499ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
110952025-08-01T16:09:50.499ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
110962025-08-01T16:09:50.499ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
110972025-08-01T16:09:50.499ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
110982025-08-01T16:09:50.500ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
110992025-08-01T16:09:50.500ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111002025-08-01T16:09:50.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111012025-08-01T16:09:50.501ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
111022025-08-01T16:09:50.501ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
111032025-08-01T16:09:50.616ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b2d16cbf-72f5-4b8e-81e4-3fefcf18b22b", "date": "Fri, 01 Aug 2025 16:09:50 GMT"} })
111042025-08-01T16:09:50.617ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch = Switch0
111052025-08-01T16:09:50.617ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
111062025-08-01T16:09:50.617ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "93f6c827-5777-47f4-a26d-8fe353a76c96", "content-length": "682", "date": "Fri, 01 Aug 2025 16:09:50 GMT"} })
111072025-08-01T16:09:50.617ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111082025-08-01T16:09:50.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111092025-08-01T16:09:50.621ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111102025-08-01T16:09:50.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111112025-08-01T16:09:50.624ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111122025-08-01T16:09:50.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111132025-08-01T16:09:50.626ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111142025-08-01T16:09:50.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111152025-08-01T16:09:50.634ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 875.400633ms iteration = 25 status = {}
111162025-08-01T16:09:51.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c7c1f632-9ca0-4928-97d7-5c5bd748e371 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111172025-08-01T16:09:51.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c7c1f632-9ca0-4928-97d7-5c5bd748e371 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111182025-08-01T16:09:51.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2272 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c7c1f632-9ca0-4928-97d7-5c5bd748e371 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111192025-08-01T16:09:52.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fd96bb0b-25a0-4bfa-8e5e-ed40c04d49e0 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111202025-08-01T16:09:52.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fd96bb0b-25a0-4bfa-8e5e-ed40c04d49e0 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111212025-08-01T16:09:52.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2515 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fd96bb0b-25a0-4bfa-8e5e-ed40c04d49e0 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111222025-08-01T16:09:53.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6f130c53-127d-40ef-a5b7-4132fa4b5cf3 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111232025-08-01T16:09:53.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6f130c53-127d-40ef-a5b7-4132fa4b5cf3 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111242025-08-01T16:09:53.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2406 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6f130c53-127d-40ef-a5b7-4132fa4b5cf3 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111252025-08-01T16:09:54.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7eb5f802-4c14-4665-b858-27ae83f4faa5 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111262025-08-01T16:09:54.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7eb5f802-4c14-4665-b858-27ae83f4faa5 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111272025-08-01T16:09:54.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2737 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7eb5f802-4c14-4665-b858-27ae83f4faa5 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111282025-08-01T16:09:54.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 146 reason = Timeout
111292025-08-01T16:09:54.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
111302025-08-01T16:09:54.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
111312025-08-01T16:09:54.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111322025-08-01T16:09:54.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
111332025-08-01T16:09:54.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
111342025-08-01T16:09:54.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
111352025-08-01T16:09:54.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
111362025-08-01T16:09:54.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.123686ms iteration = 146 status = {"chicken_switches_updated":false}
111372025-08-01T16:09:55.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b2714d35-e3d9-4bb4-8dc2-faa1cc0816fc roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111382025-08-01T16:09:55.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b2714d35-e3d9-4bb4-8dc2-faa1cc0816fc resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111392025-08-01T16:09:55.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3839 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b2714d35-e3d9-4bb4-8dc2-faa1cc0816fc response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111402025-08-01T16:09:56.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0cd5f5e9-b546-4f63-84b9-62b05b092eaa roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111412025-08-01T16:09:56.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0cd5f5e9-b546-4f63-84b9-62b05b092eaa resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111422025-08-01T16:09:56.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3698 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0cd5f5e9-b546-4f63-84b9-62b05b092eaa response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111432025-08-01T16:09:57.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b8be73e6-951e-4be3-a7ed-0d5907bf7488 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111442025-08-01T16:09:57.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b8be73e6-951e-4be3-a7ed-0d5907bf7488 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111452025-08-01T16:09:57.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2440 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b8be73e6-951e-4be3-a7ed-0d5907bf7488 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111462025-08-01T16:09:58.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bde92f4a-6b09-4a54-97dc-3ab2868a4ddb roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111472025-08-01T16:09:58.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bde92f4a-6b09-4a54-97dc-3ab2868a4ddb resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111482025-08-01T16:09:58.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3273 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bde92f4a-6b09-4a54-97dc-3ab2868a4ddb response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111492025-08-01T16:09:59.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ce5fc96b-eba6-4f17-85e1-68204529ed6f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111502025-08-01T16:09:59.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ce5fc96b-eba6-4f17-85e1-68204529ed6f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111512025-08-01T16:09:59.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2462 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ce5fc96b-eba6-4f17-85e1-68204529ed6f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111522025-08-01T16:09:59.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
111532025-08-01T16:09:59.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 147 reason = Timeout
111542025-08-01T16:09:59.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111552025-08-01T16:09:59.758ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
111562025-08-01T16:09:59.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
111572025-08-01T16:09:59.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111582025-08-01T16:09:59.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
111592025-08-01T16:09:59.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111602025-08-01T16:09:59.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111612025-08-01T16:09:59.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111622025-08-01T16:09:59.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111632025-08-01T16:09:59.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111642025-08-01T16:09:59.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111652025-08-01T16:09:59.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
111662025-08-01T16:09:59.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
111672025-08-01T16:09:59.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111682025-08-01T16:09:59.766ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
111692025-08-01T16:09:59.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111702025-08-01T16:09:59.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
111712025-08-01T16:09:59.768ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
111722025-08-01T16:09:59.768ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 10.136387ms iteration = 147 status = {"chicken_switches_updated":false}
111732025-08-01T16:09:59.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111742025-08-01T16:09:59.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111752025-08-01T16:09:59.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111762025-08-01T16:09:59.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
111772025-08-01T16:09:59.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111782025-08-01T16:09:59.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111792025-08-01T16:09:59.790ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
111802025-08-01T16:09:59.790ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 31.805414ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
111812025-08-01T16:09:59.798ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.622071ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
111822025-08-01T16:09:59.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = 46fd676e-be76-4e82-92a0-5970a9adb9b4 roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
111832025-08-01T16:09:59.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = 46fd676e-be76-4e82-92a0-5970a9adb9b4 resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
111842025-08-01T16:09:59.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3210 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = 46fd676e-be76-4e82-92a0-5970a9adb9b4 response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
111852025-08-01T16:09:59.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = 551ce638-d6b9-468d-a8ea-293bf2c5c3aa roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
111862025-08-01T16:09:59.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = 551ce638-d6b9-468d-a8ea-293bf2c5c3aa resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
111872025-08-01T16:09:59.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2825 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = 551ce638-d6b9-468d-a8ea-293bf2c5c3aa response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
111882025-08-01T16:09:59.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 536 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = fb4ca05d-487a-491d-b204-ae11e68ca265 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
111892025-08-01T16:10:00.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1632bb7c-9d36-4cc5-a58a-de81b01549af roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111902025-08-01T16:10:00.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1632bb7c-9d36-4cc5-a58a-de81b01549af resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111912025-08-01T16:10:00.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2425 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1632bb7c-9d36-4cc5-a58a-de81b01549af response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
111922025-08-01T16:10:00.775ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 192ce4c2-66ae-4122-84db-a6a2e2fdc657 remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 49754140-bff6-4977-9105-bad40109a600 uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-08-01T16:10:00.760913106Z }
111932025-08-01T16:10:00.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 49754140-bff6-4977-9105-bad40109a600 roles = RoleSet { roles: {} } uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657
111942025-08-01T16:10:00.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 49754140-bff6-4977-9105-bad40109a600 resource = Database result = Ok(()) uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657
111952025-08-01T16:10:00.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 37797 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 49754140-bff6-4977-9105-bad40109a600 response_code = 204 uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657
111962025-08-01T16:10:00.799ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 192ce4c2-66ae-4122-84db-a6a2e2fdc657 remote_addr = [fd00:1122:3344:101::1]:50147 req_id = eae3a6f5-bc24-4b40-a318-2779f5e47da6 uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-08-01T16:10:00.799293620Z }
111972025-08-01T16:10:00.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:50147 req_id = eae3a6f5-bc24-4b40-a318-2779f5e47da6 roles = RoleSet { roles: {} } uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657
111982025-08-01T16:10:00.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:50147 req_id = eae3a6f5-bc24-4b40-a318-2779f5e47da6 resource = Database result = Ok(()) uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657
111992025-08-01T16:10:00.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 7722 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:50147 req_id = eae3a6f5-bc24-4b40-a318-2779f5e47da6 response_code = 204 uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657
112002025-08-01T16:10:01.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 304dd842-b583-4cc2-863b-cc9d5bad6087 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112012025-08-01T16:10:01.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 304dd842-b583-4cc2-863b-cc9d5bad6087 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112022025-08-01T16:10:01.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2560 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 304dd842-b583-4cc2-863b-cc9d5bad6087 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112032025-08-01T16:10:02.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 51c178a1-d1b1-4832-a0cc-4961da4a03e5 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112042025-08-01T16:10:02.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 51c178a1-d1b1-4832-a0cc-4961da4a03e5 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112052025-08-01T16:10:02.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2065 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 51c178a1-d1b1-4832-a0cc-4961da4a03e5 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112062025-08-01T16:10:03.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6a394ad9-ce93-4e1c-b611-585380539b2a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112072025-08-01T16:10:03.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6a394ad9-ce93-4e1c-b611-585380539b2a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112082025-08-01T16:10:03.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2644 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6a394ad9-ce93-4e1c-b611-585380539b2a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112092025-08-01T16:10:04.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 856d034c-9deb-4432-92e1-74ab14be9376 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112102025-08-01T16:10:04.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 856d034c-9deb-4432-92e1-74ab14be9376 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112112025-08-01T16:10:04.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2309 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 856d034c-9deb-4432-92e1-74ab14be9376 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112122025-08-01T16:10:04.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 148 reason = Timeout
112132025-08-01T16:10:04.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
112142025-08-01T16:10:04.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
112152025-08-01T16:10:04.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112162025-08-01T16:10:04.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
112172025-08-01T16:10:04.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
112182025-08-01T16:10:04.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
112192025-08-01T16:10:04.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
112202025-08-01T16:10:04.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.078755ms iteration = 148 status = {"chicken_switches_updated":false}
112212025-08-01T16:10:05.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e169e22a-93ae-41bd-92b7-cbb54545510c roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112222025-08-01T16:10:05.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e169e22a-93ae-41bd-92b7-cbb54545510c resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112232025-08-01T16:10:05.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2025 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e169e22a-93ae-41bd-92b7-cbb54545510c response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112242025-08-01T16:10:06.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 59514ab7-6edf-4f56-adbd-677cadecd156 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112252025-08-01T16:10:06.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 59514ab7-6edf-4f56-adbd-677cadecd156 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112262025-08-01T16:10:06.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2279 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 59514ab7-6edf-4f56-adbd-677cadecd156 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112272025-08-01T16:10:07.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 466db322-ffcd-43fe-b88a-b9bfaf5124c5 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112282025-08-01T16:10:07.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 466db322-ffcd-43fe-b88a-b9bfaf5124c5 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112292025-08-01T16:10:07.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2675 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 466db322-ffcd-43fe-b88a-b9bfaf5124c5 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112302025-08-01T16:10:08.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a1523125-666e-4f7d-9660-7af7671315ea roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112312025-08-01T16:10:08.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a1523125-666e-4f7d-9660-7af7671315ea resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112322025-08-01T16:10:08.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2479 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a1523125-666e-4f7d-9660-7af7671315ea response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112332025-08-01T16:10:09.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2f8ee0c2-9bfe-4408-9a1f-a2a8e55967da roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112342025-08-01T16:10:09.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2f8ee0c2-9bfe-4408-9a1f-a2a8e55967da resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112352025-08-01T16:10:09.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2514 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2f8ee0c2-9bfe-4408-9a1f-a2a8e55967da response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112362025-08-01T16:10:09.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
112372025-08-01T16:10:09.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 149 reason = Timeout
112382025-08-01T16:10:09.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112392025-08-01T16:10:09.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
112402025-08-01T16:10:09.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112412025-08-01T16:10:09.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
112422025-08-01T16:10:09.758ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
112432025-08-01T16:10:09.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112442025-08-01T16:10:09.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112452025-08-01T16:10:09.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112462025-08-01T16:10:09.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112472025-08-01T16:10:09.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
112482025-08-01T16:10:09.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112492025-08-01T16:10:09.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
112502025-08-01T16:10:09.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
112512025-08-01T16:10:09.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112522025-08-01T16:10:09.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
112532025-08-01T16:10:09.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112542025-08-01T16:10:09.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112552025-08-01T16:10:09.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
112562025-08-01T16:10:09.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.750825ms iteration = 149 status = {"chicken_switches_updated":false}
112572025-08-01T16:10:09.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112582025-08-01T16:10:09.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
112592025-08-01T16:10:09.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112602025-08-01T16:10:09.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112612025-08-01T16:10:09.786ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
112622025-08-01T16:10:09.786ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.028699ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
112632025-08-01T16:10:09.793ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112642025-08-01T16:10:09.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112652025-08-01T16:10:09.834ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 75.731756ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
112662025-08-01T16:10:09.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 890 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = b6f7592a-939c-4183-823e-df4a4bd14afb response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
112672025-08-01T16:10:10.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 67a7c625-ef64-4ee4-96b5-15f1cdce48fe roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112682025-08-01T16:10:10.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 67a7c625-ef64-4ee4-96b5-15f1cdce48fe resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112692025-08-01T16:10:10.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2881 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 67a7c625-ef64-4ee4-96b5-15f1cdce48fe response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112702025-08-01T16:10:11.210ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 192ce4c2-66ae-4122-84db-a6a2e2fdc657 remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5ddf8e6f-c37f-4626-9c51-c83df77a54b8 uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-08-01T16:10:11.209784543Z }
112712025-08-01T16:10:11.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5ddf8e6f-c37f-4626-9c51-c83df77a54b8 roles = RoleSet { roles: {} } uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657
112722025-08-01T16:10:11.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5ddf8e6f-c37f-4626-9c51-c83df77a54b8 resource = Database result = Ok(()) uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657
112732025-08-01T16:10:11.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 11753 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5ddf8e6f-c37f-4626-9c51-c83df77a54b8 response_code = 204 uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657
112742025-08-01T16:10:11.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 79b8cc3f-7c03-43db-8136-1e86e5c58c84 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112752025-08-01T16:10:11.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 79b8cc3f-7c03-43db-8136-1e86e5c58c84 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112762025-08-01T16:10:11.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1867 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 79b8cc3f-7c03-43db-8136-1e86e5c58c84 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112772025-08-01T16:10:12.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1222a62b-40a9-4929-9174-9582620ff6b3 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112782025-08-01T16:10:12.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1222a62b-40a9-4929-9174-9582620ff6b3 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112792025-08-01T16:10:12.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1933 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1222a62b-40a9-4929-9174-9582620ff6b3 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
112802025-08-01T16:10:13.600ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 192ce4c2-66ae-4122-84db-a6a2e2fdc657 remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df279b25-32f2-40f1-9c00-b6ec0895c081 uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-08-01T16:10:11.222006473Z }
112812025-08-01T16:10:13.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df279b25-32f2-40f1-9c00-b6ec0895c081 roles = RoleSet { roles: {} } uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657
112822025-08-01T16:10:13.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df279b25-32f2-40f1-9c00-b6ec0895c081 resource = Database result = Ok(()) uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657
112832025-08-01T16:10:13.608ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 192ce4c2-66ae-4122-84db-a6a2e2fdc657 remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df279b25-32f2-40f1-9c00-b6ec0895c081 uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657 vmm_needs_update = true
112842025-08-01T16:10:13.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df279b25-32f2-40f1-9c00-b6ec0895c081 roles = RoleSet { roles: {} } uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657
112852025-08-01T16:10:13.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df279b25-32f2-40f1-9c00-b6ec0895c081 resource = Database result = Ok(()) uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657
112862025-08-01T16:10:13.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df279b25-32f2-40f1-9c00-b6ec0895c081 roles = RoleSet { roles: {} } uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657
112872025-08-01T16:10:13.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df279b25-32f2-40f1-9c00-b6ec0895c081 resource = Database result = Ok(()) uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657
112882025-08-01T16:10:13.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df279b25-32f2-40f1-9c00-b6ec0895c081 roles = RoleSet { roles: {} } uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657
112892025-08-01T16:10:13.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df279b25-32f2-40f1-9c00-b6ec0895c081 resource = Database result = Ok(()) uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657
112902025-08-01T16:10:13.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df279b25-32f2-40f1-9c00-b6ec0895c081 roles = RoleSet { roles: {} } uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657
112912025-08-01T16:10:13.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df279b25-32f2-40f1-9c00-b6ec0895c081 resource = Database result = Ok(()) uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657
112922025-08-01T16:10:13.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df279b25-32f2-40f1-9c00-b6ec0895c081 roles = RoleSet { roles: {} } uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657
112932025-08-01T16:10:13.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df279b25-32f2-40f1-9c00-b6ec0895c081 resource = Database result = Ok(()) uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657
112942025-08-01T16:10:13.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df279b25-32f2-40f1-9c00-b6ec0895c081 roles = RoleSet { roles: {} } uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657
112952025-08-01T16:10:13.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df279b25-32f2-40f1-9c00-b6ec0895c081 resource = Database result = Ok(()) uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657
112962025-08-01T16:10:13.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df279b25-32f2-40f1-9c00-b6ec0895c081 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657
112972025-08-01T16:10:13.624ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df279b25-32f2-40f1-9c00-b6ec0895c081 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: eec17da7-eb17-4917-8728-908698b69bbe, lookup_type: ById(eec17da7-eb17-4917-8728-908698b69bbe) }, key: 04b7dec1-1540-442d-95be-32aa3f098183, lookup_type: ById(04b7dec1-1540-442d-95be-32aa3f098183) }, key: 6e4cb9f0-dc48-49b3-8703-16aaadad9590, lookup_type: ById(6e4cb9f0-dc48-49b3-8703-16aaadad9590) } result = Ok(()) uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657
112982025-08-01T16:10:13.632ZINFOnexus (dropshot_internal): starting update saga for 6e4cb9f0-dc48-49b3-8703-16aaadad9590 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1603 instance_id = 6e4cb9f0-dc48-49b3-8703-16aaadad9590 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df279b25-32f2-40f1-9c00-b6ec0895c081 uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-08-01T16:10:11.222006473Z }
112992025-08-01T16:10:13.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 32295 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df279b25-32f2-40f1-9c00-b6ec0895c081 response_code = 204 uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657
113002025-08-01T16:10:13.634ZDEBGnexus (dropshot_internal): preparing instance-update saga for 6e4cb9f0-dc48-49b3-8703-16aaadad9590... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 6e4cb9f0-dc48-49b3-8703-16aaadad9590 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:50147 req_id = df279b25-32f2-40f1-9c00-b6ec0895c081 uri = /vmms/192ce4c2-66ae-4122-84db-a6a2e2fdc657
113012025-08-01T16:10:13.634ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update
113022025-08-01T16:10:13.637ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"6e4cb9f0-dc48-49b3-8703-16aaadad9590","lookup_type":{"ById":"6e4cb9f0-dc48-49b3-8703-16aaadad9590"},"parent":{"key":"04b7dec1-1540-442d-95be-32aa3f098183","lookup_type":{"ById":"04b7dec1-1540-442d-95be-32aa3f098183"},"parent":{"key":"eec17da7-eb17-4917-8728-908698b69bbe","lookup_type":{"ById":"eec17da7-eb17-4917-8728-908698b69bbe"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
113032025-08-01T16:10:13.637ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update
113042025-08-01T16:10:13.683ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update
113052025-08-01T16:10:13.683ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
113062025-08-01T16:10:13.686ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
113072025-08-01T16:10:13.686ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 93443257-789e-4da3-828e-bfcbd907dc14
113082025-08-01T16:10:13.695ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
113092025-08-01T16:10:13.695ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 93443257-789e-4da3-828e-bfcbd907dc14
113102025-08-01T16:10:13.699ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
113112025-08-01T16:10:13.699ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 93443257-789e-4da3-828e-bfcbd907dc14
113122025-08-01T16:10:13.704ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
113132025-08-01T16:10:13.704ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("b73b85fa-6f9f-4727-adc9-b28220925b34")) node_id = 0 saga_id = 93443257-789e-4da3-828e-bfcbd907dc14
113142025-08-01T16:10:13.707ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
113152025-08-01T16:10:13.707ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 93443257-789e-4da3-828e-bfcbd907dc14
113162025-08-01T16:10:13.726ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 6e4cb9f0-dc48-49b3-8703-16aaadad9590 saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update
113172025-08-01T16:10:13.726ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = LockInstance
113182025-08-01T16:10:13.727ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = LockInstance
113192025-08-01T16:10:13.729ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = LockInstance
113202025-08-01T16:10:13.729ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = LockInstance
113212025-08-01T16:10:13.731ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = LockInstance
113222025-08-01T16:10:13.731ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = LockInstance
113232025-08-01T16:10:13.733ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = LockInstance
113242025-08-01T16:10:13.733ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = LockInstance
113252025-08-01T16:10:13.735ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = LockInstance
113262025-08-01T16:10:13.735ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = LockInstance
113272025-08-01T16:10:13.736ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = LockInstance
113282025-08-01T16:10:13.737ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = LockInstance
113292025-08-01T16:10:13.738ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = LockInstance
113302025-08-01T16:10:13.742ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: eec17da7-eb17-4917-8728-908698b69bbe, lookup_type: ById(eec17da7-eb17-4917-8728-908698b69bbe) }, key: 04b7dec1-1540-442d-95be-32aa3f098183, lookup_type: ById(04b7dec1-1540-442d-95be-32aa3f098183) }, key: 6e4cb9f0-dc48-49b3-8703-16aaadad9590, lookup_type: ById(6e4cb9f0-dc48-49b3-8703-16aaadad9590) } result = Ok(()) saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = LockInstance
113312025-08-01T16:10:13.742ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 6e4cb9f0-dc48-49b3-8703-16aaadad9590 saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = LockInstance updater_id = b73b85fa-6f9f-4727-adc9-b28220925b34
113322025-08-01T16:10:13.742ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = LockInstance
113332025-08-01T16:10:13.742ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = LockInstance
113342025-08-01T16:10:13.753ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 6e4cb9f0-dc48-49b3-8703-16aaadad9590 saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = LockInstance updater_id = b73b85fa-6f9f-4727-adc9-b28220925b34
113352025-08-01T16:10:13.753ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = LockInstance
113362025-08-01T16:10:13.753ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = LockInstance
113372025-08-01T16:10:13.758ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 6e4cb9f0-dc48-49b3-8703-16aaadad9590 locked_gen = Generation(Generation(2)) saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = LockInstance updater_id = b73b85fa-6f9f-4727-adc9-b28220925b34
113382025-08-01T16:10:13.761ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
113392025-08-01T16:10:13.761ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("b73b85fa-6f9f-4727-adc9-b28220925b34")}) node_id = 1 saga_id = 93443257-789e-4da3-828e-bfcbd907dc14
113402025-08-01T16:10:13.764ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
113412025-08-01T16:10:13.764ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 93443257-789e-4da3-828e-bfcbd907dc14
113422025-08-01T16:10:13.769ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
113432025-08-01T16:10:13.770ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
113442025-08-01T16:10:13.771ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
113452025-08-01T16:10:13.771ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
113462025-08-01T16:10:13.772ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
113472025-08-01T16:10:13.773ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
113482025-08-01T16:10:13.774ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
113492025-08-01T16:10:13.777ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: eec17da7-eb17-4917-8728-908698b69bbe, lookup_type: ById(eec17da7-eb17-4917-8728-908698b69bbe) }, key: 04b7dec1-1540-442d-95be-32aa3f098183, lookup_type: ById(04b7dec1-1540-442d-95be-32aa3f098183) }, key: 6e4cb9f0-dc48-49b3-8703-16aaadad9590, lookup_type: ById(6e4cb9f0-dc48-49b3-8703-16aaadad9590) } result = Ok(()) saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
113502025-08-01T16:10:13.777ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
113512025-08-01T16:10:13.777ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
113522025-08-01T16:10:13.786ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 192ce4c2-66ae-4122-84db-a6a2e2fdc657, time_created: 2025-08-01T16:09:53.033714Z, time_deleted: None, instance_id: 6e4cb9f0-dc48-49b3-8703-16aaadad9590, sled_id: c9f3bda2-4996-4bda-a233-772410078d0a, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-08-01T16:10:11.222006Z, gen: Generation(Generation(7)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-08-01T16:09:50.836754Z, gen: Generation(Generation(3)), propolis_id: Some(192ce4c2-66ae-4122-84db-a6a2e2fdc657), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 6e4cb9f0-dc48-49b3-8703-16aaadad9590 saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(192ce4c2-66ae-4122-84db-a6a2e2fdc657 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-08-01T16:10:13.783752126Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
113532025-08-01T16:10:13.793ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update
113542025-08-01T16:10:13.794ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"6e4cb9f0-dc48-49b3-8703-16aaadad9590","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"192ce4c2-66ae-4122-84db-a6a2e2fdc657"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"6e4cb9f0-dc48-49b3-8703-16aaadad9590","lookup_type":{"ById":"6e4cb9f0-dc48-49b3-8703-16aaadad9590"},"parent":{"key":"04b7dec1-1540-442d-95be-32aa3f098183","lookup_type":{"ById":"04b7dec1-1540-442d-95be-32aa3f098183"},"parent":{"key":"eec17da7-eb17-4917-8728-908698b69bbe","lookup_type":{"ById":"eec17da7-eb17-4917-8728-908698b69bbe"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"b73b85fa-6f9f-4727-adc9-b28220925b34"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"04b7dec1-1540-442d-95be-32aa3f098183","ram_diff":1073741824},"destroy_active_vmm":"192ce4c2-66ae-4122-84db-a6a2e2fdc657","destroy_target_vmm":null,"network_config":"Delete","new_intent":null,"new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-08-01T16:10:13.783752126Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
113552025-08-01T16:10:13.794ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update
113562025-08-01T16:10:13.797ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update
113572025-08-01T16:10:13.797ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
113582025-08-01T16:10:13.797ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
113592025-08-01T16:10:13.797ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
113602025-08-01T16:10:13.801ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
113612025-08-01T16:10:13.801ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
113622025-08-01T16:10:13.806ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
113632025-08-01T16:10:13.806ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
113642025-08-01T16:10:13.808ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
113652025-08-01T16:10:13.808ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("03462223-eace-48b4-a87c-a67b6b139780")) node_id = 0 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
113662025-08-01T16:10:13.811ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
113672025-08-01T16:10:13.811ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
113682025-08-01T16:10:13.817ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 6e4cb9f0-dc48-49b3-8703-16aaadad9590 parent_lock = UpdaterLock { updater_id: b73b85fa-6f9f-4727-adc9-b28220925b34, locked_gen: Generation(Generation(2)) } saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update
113692025-08-01T16:10:13.817ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = BecomeUpdater
113702025-08-01T16:10:13.817ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = BecomeUpdater
113712025-08-01T16:10:13.825ZDEBGnexus (SagaExecutor): inherited lock from b73b85fa-6f9f-4727-adc9-b28220925b34 to 03462223-eace-48b4-a87c-a67b6b139780 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 6e4cb9f0-dc48-49b3-8703-16aaadad9590 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = b73b85fa-6f9f-4727-adc9-b28220925b34 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = BecomeUpdater updater_id = 03462223-eace-48b4-a87c-a67b6b139780
113722025-08-01T16:10:13.825ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:987 instance_id = 6e4cb9f0-dc48-49b3-8703-16aaadad9590 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update
113732025-08-01T16:10:13.825ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
113742025-08-01T16:10:13.825ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("03462223-eace-48b4-a87c-a67b6b139780")}) node_id = 1 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
113752025-08-01T16:10:13.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 30d64482-b4c6-47ae-9809-a90c7fe52d7c roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
113762025-08-01T16:10:13.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 30d64482-b4c6-47ae-9809-a90c7fe52d7c resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
113772025-08-01T16:10:13.828ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
113782025-08-01T16:10:13.828ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
113792025-08-01T16:10:13.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2425 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 30d64482-b4c6-47ae-9809-a90c7fe52d7c response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
113802025-08-01T16:10:13.831ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
113812025-08-01T16:10:13.831ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
113822025-08-01T16:10:13.834ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
113832025-08-01T16:10:13.834ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
113842025-08-01T16:10:13.840ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1040 instance_id = 6e4cb9f0-dc48-49b3-8703-16aaadad9590 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update
113852025-08-01T16:10:13.840ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 6e4cb9f0-dc48-49b3-8703-16aaadad9590
113862025-08-01T16:10:13.843ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = UpdateNetworkConfig
113872025-08-01T16:10:13.843ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = UpdateNetworkConfig
113882025-08-01T16:10:13.850ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = UpdateNetworkConfig
113892025-08-01T16:10:13.850ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = UpdateNetworkConfig
113902025-08-01T16:10:13.852ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
113912025-08-01T16:10:13.852ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = UpdateNetworkConfig
113922025-08-01T16:10:13.852ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = UpdateNetworkConfig
113932025-08-01T16:10:13.854ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
113942025-08-01T16:10:13.854ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
113952025-08-01T16:10:13.855ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
113962025-08-01T16:10:13.856ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
113972025-08-01T16:10:13.858ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
113982025-08-01T16:10:13.858ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
113992025-08-01T16:10:13.858ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
114002025-08-01T16:10:13.861ZDEBGnexus: notifying dendrite of updates instance_id = Some(6e4cb9f0-dc48-49b3-8703-16aaadad9590 (instance)) switch = switch0
114012025-08-01T16:10:13.862ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44309, tv_nsec: 879035379 } })
114022025-08-01T16:10:13.865ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1186
114032025-08-01T16:10:13.895ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
114042025-08-01T16:10:13.895ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
114052025-08-01T16:10:13.895ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "946c6058-8fbe-4619-9033-02be8c31a2d9", "content-length": "26", "date": "Fri, 01 Aug 2025 16:10:13 GMT"} })
114062025-08-01T16:10:13.895ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
114072025-08-01T16:10:13.896ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
114082025-08-01T16:10:13.926ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
114092025-08-01T16:10:13.926ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
114102025-08-01T16:10:13.930ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
114112025-08-01T16:10:13.930ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
114122025-08-01T16:10:13.933ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
114132025-08-01T16:10:13.933ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
114142025-08-01T16:10:13.947ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1115 instance_id = 6e4cb9f0-dc48-49b3-8703-16aaadad9590 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-08-01T16:10:13.937420Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 04b7dec1-1540-442d-95be-32aa3f098183, time_modified: Some(2025-08-01T16:10:13.937420Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: eec17da7-eb17-4917-8728-908698b69bbe, time_modified: Some(2025-08-01T16:10:13.937420Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update
114152025-08-01T16:10:13.949ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
114162025-08-01T16:10:13.949ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
114172025-08-01T16:10:13.952ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
114182025-08-01T16:10:13.952ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
114192025-08-01T16:10:13.957ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1150 instance_id = 6e4cb9f0-dc48-49b3-8703-16aaadad9590 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update
114202025-08-01T16:10:13.957ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = UnassignOximeterProducer
114212025-08-01T16:10:13.957ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = UnassignOximeterProducer
114222025-08-01T16:10:13.961ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 7bf2727d-8ae8-417c-81cf-59aa0ad1690b producer_id = 6e4cb9f0-dc48-49b3-8703-16aaadad9590 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update
114232025-08-01T16:10:13.961ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = UnassignOximeterProducer
114242025-08-01T16:10:13.962ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = UnassignOximeterProducer
114252025-08-01T16:10:14.002ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 6e4cb9f0-dc48-49b3-8703-16aaadad9590 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update
114262025-08-01T16:10:14.002ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 6e4cb9f0-dc48-49b3-8703-16aaadad9590 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/6e4cb9f0-dc48-49b3-8703-16aaadad9590
114272025-08-01T16:10:14.016ZDEBGnexus (SagaExecutor): client response oximeter-collector = 6e4cb9f0-dc48-49b3-8703-16aaadad9590 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/6e4cb9f0-dc48-49b3-8703-16aaadad9590", status: 204, headers: {"x-request-id": "1d165e34-e5b3-4797-a481-8cce1233eb13", "date": "Fri, 01 Aug 2025 16:10:14 GMT"} }) saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update
114282025-08-01T16:10:14.016ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 7bf2727d-8ae8-417c-81cf-59aa0ad1690b producer_id = 6e4cb9f0-dc48-49b3-8703-16aaadad9590 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update
114292025-08-01T16:10:14.017ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
114302025-08-01T16:10:14.017ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
114312025-08-01T16:10:14.020ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
114322025-08-01T16:10:14.020ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
114332025-08-01T16:10:14.026ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 6e4cb9f0-dc48-49b3-8703-16aaadad9590 lock = UpdaterLock { updater_id: 03462223-eace-48b4-a87c-a67b6b139780, locked_gen: Generation(Generation(3)) } new_intent = None new_runtime = InstanceRuntimeState { time_updated: 2025-08-01T16:10:13.783752126Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update
114342025-08-01T16:10:14.026ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = CommitInstanceUpdates
114352025-08-01T16:10:14.026ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = CommitInstanceUpdates
114362025-08-01T16:10:14.037ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1201 instance_id = 6e4cb9f0-dc48-49b3-8703-16aaadad9590 new_runtime = InstanceRuntimeState { time_updated: 2025-08-01T16:10:13.783752126Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update
114372025-08-01T16:10:14.037ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Signaled
114382025-08-01T16:10:14.037ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
114392025-08-01T16:10:14.037ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
114402025-08-01T16:10:14.037ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
114412025-08-01T16:10:14.037ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
114422025-08-01T16:10:14.037ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114432025-08-01T16:10:14.037ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114442025-08-01T16:10:14.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114452025-08-01T16:10:14.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114462025-08-01T16:10:14.038ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114472025-08-01T16:10:14.040ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
114482025-08-01T16:10:14.040ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
114492025-08-01T16:10:14.041ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
114502025-08-01T16:10:14.041ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114512025-08-01T16:10:14.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114522025-08-01T16:10:14.043ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114532025-08-01T16:10:14.043ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
114542025-08-01T16:10:14.043ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("6e4cb9f0-dc48-49b3-8703-16aaadad9590"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("192ce4c2-66ae-4122-84db-a6a2e2fdc657")}) node_id = 7 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
114552025-08-01T16:10:14.045ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
114562025-08-01T16:10:14.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114572025-08-01T16:10:14.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114582025-08-01T16:10:14.046ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
114592025-08-01T16:10:14.046ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
114602025-08-01T16:10:14.049ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
114612025-08-01T16:10:14.049ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
114622025-08-01T16:10:14.049ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114632025-08-01T16:10:14.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114642025-08-01T16:10:14.052ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
114652025-08-01T16:10:14.052ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
114662025-08-01T16:10:14.056ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:82 instance_id = 6e4cb9f0-dc48-49b3-8703-16aaadad9590 propolis_id = 192ce4c2-66ae-4122-84db-a6a2e2fdc657 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update
114672025-08-01T16:10:14.056ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = ReleaseSledResources
114682025-08-01T16:10:14.056ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = ReleaseSledResources
114692025-08-01T16:10:14.060ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
114702025-08-01T16:10:14.060ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
114712025-08-01T16:10:14.064ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
114722025-08-01T16:10:14.064ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
114732025-08-01T16:10:14.067ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:113 instance_id = 6e4cb9f0-dc48-49b3-8703-16aaadad9590 propolis_id = 192ce4c2-66ae-4122-84db-a6a2e2fdc657 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update
114742025-08-01T16:10:14.067ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = MarkVmmDeleted
114752025-08-01T16:10:14.067ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = MarkVmmDeleted
114762025-08-01T16:10:14.078ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
114772025-08-01T16:10:14.078ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
114782025-08-01T16:10:14.078ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "58a7462d-b7a9-4527-a7e7-78cdae89ac2a", "content-length": "372", "date": "Fri, 01 Aug 2025 16:10:14 GMT"} })
114792025-08-01T16:10:14.078ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114802025-08-01T16:10:14.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114812025-08-01T16:10:14.094ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114822025-08-01T16:10:14.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114832025-08-01T16:10:14.095ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114842025-08-01T16:10:14.098ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
114852025-08-01T16:10:14.098ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114862025-08-01T16:10:14.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114872025-08-01T16:10:14.100ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114882025-08-01T16:10:14.102ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
114892025-08-01T16:10:14.102ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114902025-08-01T16:10:14.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114912025-08-01T16:10:14.114ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
114922025-08-01T16:10:14.114ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
114932025-08-01T16:10:14.117ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
114942025-08-01T16:10:14.117ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
114952025-08-01T16:10:14.121ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
114962025-08-01T16:10:14.121ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
114972025-08-01T16:10:14.123ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
114982025-08-01T16:10:14.123ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
114992025-08-01T16:10:14.127ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = ChainSuccessorSaga
115002025-08-01T16:10:14.127ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = ChainSuccessorSaga
115012025-08-01T16:10:14.129ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = ChainSuccessorSaga
115022025-08-01T16:10:14.129ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = ChainSuccessorSaga
115032025-08-01T16:10:14.130ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = ChainSuccessorSaga
115042025-08-01T16:10:14.130ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = ChainSuccessorSaga
115052025-08-01T16:10:14.132ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = ChainSuccessorSaga
115062025-08-01T16:10:14.135ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: eec17da7-eb17-4917-8728-908698b69bbe, lookup_type: ById(eec17da7-eb17-4917-8728-908698b69bbe) }, key: 04b7dec1-1540-442d-95be-32aa3f098183, lookup_type: ById(04b7dec1-1540-442d-95be-32aa3f098183) }, key: 6e4cb9f0-dc48-49b3-8703-16aaadad9590, lookup_type: ById(6e4cb9f0-dc48-49b3-8703-16aaadad9590) } result = Ok(()) saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = ChainSuccessorSaga
115072025-08-01T16:10:14.135ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = ChainSuccessorSaga
115082025-08-01T16:10:14.135ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_node = ChainSuccessorSaga
115092025-08-01T16:10:14.136ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
115102025-08-01T16:10:14.136ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {5fbaf9e9-6510-4b1d-aba2-b3cbcb39477e: {10.151.1.176: {45342320-0b0a-4d37-a56c-dcac4ea61804}, 10.151.1.175: {45342320-0b0a-4d37-a56c-dcac4ea61804}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
115112025-08-01T16:10:14.136ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e45411ed-0faa-4c3e-ad29-0c045616d34f", "content-length": "691", "date": "Fri, 01 Aug 2025 16:10:14 GMT"} })
115122025-08-01T16:10:14.136ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
115132025-08-01T16:10:14.136ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
115142025-08-01T16:10:14.136ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
115152025-08-01T16:10:14.138ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 100.769236ms iteration = 26 status = {}
115162025-08-01T16:10:14.139ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
115172025-08-01T16:10:14.139ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2601be97-27c2-4e31-9a84-1b97ef15bc9c", "date": "Fri, 01 Aug 2025 16:10:14 GMT"} })
115182025-08-01T16:10:14.139ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115192025-08-01T16:10:14.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115202025-08-01T16:10:14.141ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115212025-08-01T16:10:14.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115222025-08-01T16:10:14.143ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115232025-08-01T16:10:14.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115242025-08-01T16:10:14.146ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
115252025-08-01T16:10:14.146ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
115262025-08-01T16:10:14.146ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fa9b386f-8ec4-42e6-bed1-6fd13300b81e", "date": "Fri, 01 Aug 2025 16:10:14 GMT"} })
115272025-08-01T16:10:14.147ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 110.524241ms iteration = 26 status = {}
115282025-08-01T16:10:14.208ZWARNnexus (SagaExecutor): instance update: failed to start successor saga! error = failed to fetch latest snapshot for instance file = nexus/src/app/sagas/instance_update/mod.rs:1351 instance_id = 6e4cb9f0-dc48-49b3-8703-16aaadad9590 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update
115292025-08-01T16:10:14.208ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Signaled
115302025-08-01T16:10:14.208ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
115312025-08-01T16:10:14.208ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
115322025-08-01T16:10:14.208ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
115332025-08-01T16:10:14.208ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
115342025-08-01T16:10:14.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
115352025-08-01T16:10:14.210ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
115362025-08-01T16:10:14.210ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
115372025-08-01T16:10:14.210ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
115382025-08-01T16:10:14.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
115392025-08-01T16:10:14.212ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
115402025-08-01T16:10:14.212ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
115412025-08-01T16:10:14.212ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
115422025-08-01T16:10:14.212ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
115432025-08-01T16:10:14.212ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
115442025-08-01T16:10:14.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
115452025-08-01T16:10:14.215ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
115462025-08-01T16:10:14.215ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
115472025-08-01T16:10:14.218ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
115482025-08-01T16:10:14.218ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6
115492025-08-01T16:10:14.248ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
115502025-08-01T16:10:14.248ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
115512025-08-01T16:10:14.248ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 40.456137ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
115522025-08-01T16:10:14.259ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
115532025-08-01T16:10:14.259ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 saga_name = instance-update saga_result = SagaResult { saga_id: c10c5c0e-ecdf-4dbc-87de-1e110833f9d6, saga_log: SagaLog { saga_id: c10c5c0e-ecdf-4dbc-87de-1e110833f9d6, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("03462223-eace-48b4-a87c-a67b6b139780")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("03462223-eace-48b4-a87c-a67b6b139780")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("6e4cb9f0-dc48-49b3-8703-16aaadad9590"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("192ce4c2-66ae-4122-84db-a6a2e2fdc657")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("6e4cb9f0-dc48-49b3-8703-16aaadad9590"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("192ce4c2-66ae-4122-84db-a6a2e2fdc657")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("03462223-eace-48b4-a87c-a67b6b139780"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("03462223-eace-48b4-a87c-a67b6b139780")}} }) }
115542025-08-01T16:10:14.259ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = c10c5c0e-ecdf-4dbc-87de-1e110833f9d6 instance_id = 6e4cb9f0-dc48-49b3-8703-16aaadad9590 saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update
115552025-08-01T16:10:14.259ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
115562025-08-01T16:10:14.259ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 93443257-789e-4da3-828e-bfcbd907dc14
115572025-08-01T16:10:14.262ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
115582025-08-01T16:10:14.262ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 93443257-789e-4da3-828e-bfcbd907dc14
115592025-08-01T16:10:14.265ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
115602025-08-01T16:10:14.265ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 93443257-789e-4da3-828e-bfcbd907dc14
115612025-08-01T16:10:14.269ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
115622025-08-01T16:10:14.269ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 93443257-789e-4da3-828e-bfcbd907dc14
115632025-08-01T16:10:14.319ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update sec_id = 7248190d-c184-423c-8431-31fe40a79e2e
115642025-08-01T16:10:14.319ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 93443257-789e-4da3-828e-bfcbd907dc14 saga_name = start-instance-update saga_result = SagaResult { saga_id: 93443257-789e-4da3-828e-bfcbd907dc14, saga_log: SagaLog { saga_id: 93443257-789e-4da3-828e-bfcbd907dc14, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("b73b85fa-6f9f-4727-adc9-b28220925b34")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("b73b85fa-6f9f-4727-adc9-b28220925b34")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("b73b85fa-6f9f-4727-adc9-b28220925b34"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("b73b85fa-6f9f-4727-adc9-b28220925b34")}} }) }
115652025-08-01T16:10:14.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 150 reason = Timeout
115662025-08-01T16:10:14.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
115672025-08-01T16:10:14.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
115682025-08-01T16:10:14.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115692025-08-01T16:10:14.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
115702025-08-01T16:10:14.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
115712025-08-01T16:10:14.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
115722025-08-01T16:10:14.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
115732025-08-01T16:10:14.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.746654ms iteration = 150 status = {"chicken_switches_updated":false}
115742025-08-01T16:10:14.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3403830e-f507-42ee-9ec9-ac5f2764659d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
115752025-08-01T16:10:14.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3403830e-f507-42ee-9ec9-ac5f2764659d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
115762025-08-01T16:10:14.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2285 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3403830e-f507-42ee-9ec9-ac5f2764659d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
115772025-08-01T16:10:14.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = 4a1bec05-f9d5-4b6d-85d2-01b773916c4d roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
115782025-08-01T16:10:14.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = 4a1bec05-f9d5-4b6d-85d2-01b773916c4d resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
115792025-08-01T16:10:14.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2768 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = 4a1bec05-f9d5-4b6d-85d2-01b773916c4d response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
115802025-08-01T16:10:14.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = 95380091-459e-42d3-8633-22479ff68a77 roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
115812025-08-01T16:10:14.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = 95380091-459e-42d3-8633-22479ff68a77 resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
115822025-08-01T16:10:14.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2312 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36657 req_id = 95380091-459e-42d3-8633-22479ff68a77 response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
115832025-08-01T16:10:15.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ac44bcca-3235-4059-9008-e3f0874b195c roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
115842025-08-01T16:10:15.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ac44bcca-3235-4059-9008-e3f0874b195c resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
115852025-08-01T16:10:15.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2349 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ac44bcca-3235-4059-9008-e3f0874b195c response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
115862025-08-01T16:10:16.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 77e53c31-9933-4bbd-bf32-f9568d8f174a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
115872025-08-01T16:10:16.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 77e53c31-9933-4bbd-bf32-f9568d8f174a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
115882025-08-01T16:10:16.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2336 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 77e53c31-9933-4bbd-bf32-f9568d8f174a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
115892025-08-01T16:10:17.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 03018c7b-49c4-4c21-931a-1238dc338164 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
115902025-08-01T16:10:17.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 03018c7b-49c4-4c21-931a-1238dc338164 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
115912025-08-01T16:10:17.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2771 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 03018c7b-49c4-4c21-931a-1238dc338164 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
115922025-08-01T16:10:18.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a1d5072d-885a-4828-9618-6e6ea18d3541 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
115932025-08-01T16:10:18.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a1d5072d-885a-4828-9618-6e6ea18d3541 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
115942025-08-01T16:10:18.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2110 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a1d5072d-885a-4828-9618-6e6ea18d3541 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
115952025-08-01T16:10:19.687ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
115962025-08-01T16:10:19.687ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
115972025-08-01T16:10:19.687ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
115982025-08-01T16:10:19.687ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
115992025-08-01T16:10:19.687ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
116002025-08-01T16:10:19.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
116012025-08-01T16:10:19.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
116022025-08-01T16:10:19.693ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44315, tv_nsec: 710044789 } })
116032025-08-01T16:10:19.693ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44315, tv_nsec: 710268646 } })
116042025-08-01T16:10:19.693ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
116052025-08-01T16:10:19.693ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
116062025-08-01T16:10:19.694ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.808026ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
116072025-08-01T16:10:19.755ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
116082025-08-01T16:10:19.755ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
116092025-08-01T16:10:19.755ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "095e11da-3609-4bbc-ad94-71372eaa7005", "content-length": "26", "date": "Fri, 01 Aug 2025 16:10:19 GMT"} })
116102025-08-01T16:10:19.755ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
116112025-08-01T16:10:19.756ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
116122025-08-01T16:10:19.756ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
116132025-08-01T16:10:19.756ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
116142025-08-01T16:10:19.756ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "116a45c6-e753-48f0-a565-0823efcc6922", "content-length": "26", "date": "Fri, 01 Aug 2025 16:10:19 GMT"} })
116152025-08-01T16:10:19.756ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
116162025-08-01T16:10:19.757ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 26 reason = Timeout
116172025-08-01T16:10:19.757ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
116182025-08-01T16:10:19.757ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 13.251\u{b5}s iteration = 26 status = {"disabled":true,"errors":[],"sps":[]}
116192025-08-01T16:10:19.757ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
116202025-08-01T16:10:19.757ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
116212025-08-01T16:10:19.757ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
116222025-08-01T16:10:19.757ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
116232025-08-01T16:10:19.757ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116242025-08-01T16:10:19.757ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
116252025-08-01T16:10:19.757ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116262025-08-01T16:10:19.757ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 151 reason = Timeout
116272025-08-01T16:10:19.757ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
116282025-08-01T16:10:19.757ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 26 reason = Timeout
116292025-08-01T16:10:19.757ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
116302025-08-01T16:10:19.757ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
116312025-08-01T16:10:19.757ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
116322025-08-01T16:10:19.757ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
116332025-08-01T16:10:19.757ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
116342025-08-01T16:10:19.757ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
116352025-08-01T16:10:19.757ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
116362025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
116372025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
116382025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
116392025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
116402025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
116412025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
116422025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
116432025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
116442025-08-01T16:10:19.758ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
116452025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116462025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116472025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
116482025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
116492025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
116502025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116512025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
116522025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116532025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
116542025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
116552025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
116562025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
116572025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
116582025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
116592025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
116602025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
116612025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
116622025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116632025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116642025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
116652025-08-01T16:10:19.758ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
116662025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 26 reason = Timeout
116672025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
116682025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116692025-08-01T16:10:19.758ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
116702025-08-01T16:10:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116712025-08-01T16:10:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
116722025-08-01T16:10:19.760ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116732025-08-01T16:10:19.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116742025-08-01T16:10:19.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
116752025-08-01T16:10:19.762ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116762025-08-01T16:10:19.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116772025-08-01T16:10:19.762ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116782025-08-01T16:10:19.764ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.621111ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
116792025-08-01T16:10:19.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
116802025-08-01T16:10:19.765ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
116812025-08-01T16:10:19.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
116822025-08-01T16:10:19.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
116832025-08-01T16:10:19.766ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
116842025-08-01T16:10:19.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
116852025-08-01T16:10:19.767ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
116862025-08-01T16:10:19.767ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
116872025-08-01T16:10:19.767ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
116882025-08-01T16:10:19.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
116892025-08-01T16:10:19.770ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116902025-08-01T16:10:19.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116912025-08-01T16:10:19.770ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116922025-08-01T16:10:19.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
116932025-08-01T16:10:19.773ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
116942025-08-01T16:10:19.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
116952025-08-01T16:10:19.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
116962025-08-01T16:10:19.775ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
116972025-08-01T16:10:19.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
116982025-08-01T16:10:19.779ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44315, tv_nsec: 796236673 } })
116992025-08-01T16:10:19.779ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
117002025-08-01T16:10:19.779ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
117012025-08-01T16:10:19.779ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117022025-08-01T16:10:19.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117032025-08-01T16:10:19.781ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
117042025-08-01T16:10:19.781ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 23.394999ms iteration = 151 status = {"chicken_switches_updated":false}
117052025-08-01T16:10:19.782ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117062025-08-01T16:10:19.783ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117072025-08-01T16:10:19.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117082025-08-01T16:10:19.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117092025-08-01T16:10:19.810ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117102025-08-01T16:10:19.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117112025-08-01T16:10:19.817ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
117122025-08-01T16:10:19.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
117132025-08-01T16:10:19.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117142025-08-01T16:10:19.823ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 65.61182ms iteration = 26 status = {"errors":[],"requests_created_ok":[]}
117152025-08-01T16:10:19.823ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117162025-08-01T16:10:19.824ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
117172025-08-01T16:10:19.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
117182025-08-01T16:10:19.824ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
117192025-08-01T16:10:19.824ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117202025-08-01T16:10:19.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
117212025-08-01T16:10:19.826ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117222025-08-01T16:10:19.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117232025-08-01T16:10:19.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
117242025-08-01T16:10:19.827ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
117252025-08-01T16:10:19.827ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 140.056737ms iteration = 26 status = {}
117262025-08-01T16:10:19.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
117272025-08-01T16:10:19.829ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
117282025-08-01T16:10:19.829ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
117292025-08-01T16:10:19.829ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117302025-08-01T16:10:19.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
117312025-08-01T16:10:19.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
117322025-08-01T16:10:19.831ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 144.353577ms iteration = 26 status = null
117332025-08-01T16:10:19.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
117342025-08-01T16:10:19.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117352025-08-01T16:10:19.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117362025-08-01T16:10:19.833ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
117372025-08-01T16:10:19.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
117382025-08-01T16:10:19.838ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 80.248613ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
117392025-08-01T16:10:19.839ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
117402025-08-01T16:10:19.839ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
117412025-08-01T16:10:19.840ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
117422025-08-01T16:10:19.840ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
117432025-08-01T16:10:19.840ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
117442025-08-01T16:10:19.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
117452025-08-01T16:10:19.840ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
117462025-08-01T16:10:19.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
117472025-08-01T16:10:19.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
117482025-08-01T16:10:19.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
117492025-08-01T16:10:19.843ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
117502025-08-01T16:10:19.843ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117512025-08-01T16:10:19.843ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 85.384389ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
117522025-08-01T16:10:19.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
117532025-08-01T16:10:19.847ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
117542025-08-01T16:10:19.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
117552025-08-01T16:10:19.852ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
117562025-08-01T16:10:19.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
117572025-08-01T16:10:19.854ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 zone_address = fd00:1122:3344:101::2
117582025-08-01T16:10:19.854ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
117592025-08-01T16:10:19.854ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:391
117602025-08-01T16:10:19.854ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 95.825416ms iteration = 26 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
117612025-08-01T16:10:19.854ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "31960c2b-35c8-40e5-85f2-54a3a9b59095", "content-length": "26", "date": "Fri, 01 Aug 2025 16:10:19 GMT"} })
117622025-08-01T16:10:19.854ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
117632025-08-01T16:10:19.856ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
117642025-08-01T16:10:19.857ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117652025-08-01T16:10:19.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117662025-08-01T16:10:19.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117672025-08-01T16:10:19.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117682025-08-01T16:10:19.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117692025-08-01T16:10:19.863ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
117702025-08-01T16:10:19.864ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 105.058995ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
117712025-08-01T16:10:19.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
117722025-08-01T16:10:19.866ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117732025-08-01T16:10:19.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117742025-08-01T16:10:19.869ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 111.365457ms iteration = 26 status = 0
117752025-08-01T16:10:19.874ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 116.358548ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
117762025-08-01T16:10:19.885ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 127.575149ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
117772025-08-01T16:10:19.892ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
117782025-08-01T16:10:19.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
117792025-08-01T16:10:19.894ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 136.955093ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
117802025-08-01T16:10:19.903ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
117812025-08-01T16:10:19.903ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
117822025-08-01T16:10:19.903ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 145.587345ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
117832025-08-01T16:10:19.905ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117842025-08-01T16:10:19.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
117852025-08-01T16:10:19.909ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
117862025-08-01T16:10:19.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
117872025-08-01T16:10:19.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 820 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 090f3365-5121-4edf-995a-8c7046ae136b response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
117882025-08-01T16:10:19.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = adeb31c5-efd3-4b33-b060-e3954e93af1c roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
117892025-08-01T16:10:19.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = adeb31c5-efd3-4b33-b060-e3954e93af1c resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
117902025-08-01T16:10:19.924ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117912025-08-01T16:10:19.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2908 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = adeb31c5-efd3-4b33-b060-e3954e93af1c response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
117922025-08-01T16:10:19.928ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
117932025-08-01T16:10:19.928ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
117942025-08-01T16:10:19.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
117952025-08-01T16:10:19.930ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117962025-08-01T16:10:19.933ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
117972025-08-01T16:10:19.933ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
117982025-08-01T16:10:19.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
117992025-08-01T16:10:19.940ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 182.38516ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
118002025-08-01T16:10:20.002ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118012025-08-01T16:10:20.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118022025-08-01T16:10:20.005ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 3f21d9d5-3adf-463a-a05d-bc2e2e5d64ca, rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(4c7da70d-ede0-4107-abc5-5650a053be38) } rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
118032025-08-01T16:10:20.005ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118042025-08-01T16:10:20.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118052025-08-01T16:10:20.016ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
118062025-08-01T16:10:20.016ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d9ac448-8baa-42e4-8c18-37f6fdb75415", "content-length": "691", "date": "Fri, 01 Aug 2025 16:10:19 GMT"} })
118072025-08-01T16:10:20.016ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
118082025-08-01T16:10:20.016ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
118092025-08-01T16:10:20.016ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
118102025-08-01T16:10:20.017ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 259.682214ms iteration = 27 status = {}
118112025-08-01T16:10:20.018ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
118122025-08-01T16:10:20.018ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 4c7da70d-ede0-4107-abc5-5650a053be38
118132025-08-01T16:10:20.018ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
118142025-08-01T16:10:20.018ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
118152025-08-01T16:10:20.018ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
118162025-08-01T16:10:20.018ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
118172025-08-01T16:10:20.018ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
118182025-08-01T16:10:20.019ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
118192025-08-01T16:10:20.019ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
118202025-08-01T16:10:20.019ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
118212025-08-01T16:10:20.019ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
118222025-08-01T16:10:20.019ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118232025-08-01T16:10:20.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118242025-08-01T16:10:20.022ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
118252025-08-01T16:10:20.022ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
118262025-08-01T16:10:20.022ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
118272025-08-01T16:10:20.022ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
118282025-08-01T16:10:20.031ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5f61988-21f2-4223-b1db-1238f45c1e35", "content-length": "372", "date": "Fri, 01 Aug 2025 16:10:19 GMT"} })
118292025-08-01T16:10:20.031ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118302025-08-01T16:10:20.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118312025-08-01T16:10:20.033ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 275.517444ms iteration = 29 status = {"physical_disks_added":0}
118322025-08-01T16:10:20.081ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
118332025-08-01T16:10:20.081ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
118342025-08-01T16:10:20.082ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "210cfaee-6853-47e8-a6ec-b7fa8515b60a", "date": "Fri, 01 Aug 2025 16:10:20 GMT"} })
118352025-08-01T16:10:20.082ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118362025-08-01T16:10:20.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118372025-08-01T16:10:20.083ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118382025-08-01T16:10:20.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118392025-08-01T16:10:20.087ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118402025-08-01T16:10:20.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118412025-08-01T16:10:20.089ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
118422025-08-01T16:10:20.089ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
118432025-08-01T16:10:20.091ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f125ed57-5bff-42ca-a43a-078087581305", "date": "Fri, 01 Aug 2025 16:10:20 GMT"} })
118442025-08-01T16:10:20.092ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 334.480591ms iteration = 27 status = {}
118452025-08-01T16:10:20.139ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5579eee0-cb33-48c7-b2df-3f37e90fd083", "date": "Fri, 01 Aug 2025 16:10:20 GMT"} })
118462025-08-01T16:10:20.139ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch = Switch0
118472025-08-01T16:10:20.139ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
118482025-08-01T16:10:20.146ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "64cd5510-43ef-4566-a0ae-354cb2ddbef2", "content-length": "682", "date": "Fri, 01 Aug 2025 16:10:19 GMT"} })
118492025-08-01T16:10:20.146ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118502025-08-01T16:10:20.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118512025-08-01T16:10:20.150ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118522025-08-01T16:10:20.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118532025-08-01T16:10:20.154ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118542025-08-01T16:10:20.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118552025-08-01T16:10:20.156ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118562025-08-01T16:10:20.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118572025-08-01T16:10:20.164ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 406.233757ms iteration = 26 status = {}
118582025-08-01T16:10:20.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fc2998a8-80fc-45a4-81c3-b671edb708e6 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
118592025-08-01T16:10:20.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fc2998a8-80fc-45a4-81c3-b671edb708e6 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
118602025-08-01T16:10:20.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2439 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fc2998a8-80fc-45a4-81c3-b671edb708e6 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
118612025-08-01T16:10:21.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d5f38bc4-0b91-497d-85f4-7bc3c1e899a0 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
118622025-08-01T16:10:21.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d5f38bc4-0b91-497d-85f4-7bc3c1e899a0 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
118632025-08-01T16:10:21.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2826 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d5f38bc4-0b91-497d-85f4-7bc3c1e899a0 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
118642025-08-01T16:10:22.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ab4e564f-24fe-456c-8095-5a0c3542c12a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
118652025-08-01T16:10:22.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ab4e564f-24fe-456c-8095-5a0c3542c12a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
118662025-08-01T16:10:22.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2539 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ab4e564f-24fe-456c-8095-5a0c3542c12a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
118672025-08-01T16:10:23.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 16294232-2b68-40e9-9fe4-e8fc03d7adec roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
118682025-08-01T16:10:23.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 16294232-2b68-40e9-9fe4-e8fc03d7adec resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
118692025-08-01T16:10:23.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2697 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 16294232-2b68-40e9-9fe4-e8fc03d7adec response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
118702025-08-01T16:10:24.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 152 reason = Timeout
118712025-08-01T16:10:24.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
118722025-08-01T16:10:24.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
118732025-08-01T16:10:24.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118742025-08-01T16:10:24.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
118752025-08-01T16:10:24.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
118762025-08-01T16:10:24.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
118772025-08-01T16:10:24.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
118782025-08-01T16:10:24.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.723744ms iteration = 152 status = {"chicken_switches_updated":false}
118792025-08-01T16:10:25.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b8d0872a-e1f2-4e61-8f33-3eb377a65ff7 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
118802025-08-01T16:10:25.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b8d0872a-e1f2-4e61-8f33-3eb377a65ff7 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
118812025-08-01T16:10:25.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2229 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b8d0872a-e1f2-4e61-8f33-3eb377a65ff7 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
118822025-08-01T16:10:26.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 83da3292-a891-4f98-a132-1182f02a892f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
118832025-08-01T16:10:26.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 83da3292-a891-4f98-a132-1182f02a892f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
118842025-08-01T16:10:26.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2281 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 83da3292-a891-4f98-a132-1182f02a892f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
118852025-08-01T16:10:27.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b8931dce-a193-4260-b6e1-16b6d155e07b roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
118862025-08-01T16:10:27.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b8931dce-a193-4260-b6e1-16b6d155e07b resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
118872025-08-01T16:10:27.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2067 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b8931dce-a193-4260-b6e1-16b6d155e07b response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
118882025-08-01T16:10:28.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dde5b638-61ef-452b-ba77-158617c975b5 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
118892025-08-01T16:10:28.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dde5b638-61ef-452b-ba77-158617c975b5 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
118902025-08-01T16:10:28.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3300 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dde5b638-61ef-452b-ba77-158617c975b5 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
118912025-08-01T16:10:29.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e2ff32ec-a7a7-4c71-8ab4-1adbda622649 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
118922025-08-01T16:10:29.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e2ff32ec-a7a7-4c71-8ab4-1adbda622649 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
118932025-08-01T16:10:29.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2550 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e2ff32ec-a7a7-4c71-8ab4-1adbda622649 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
118942025-08-01T16:10:29.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
118952025-08-01T16:10:29.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 153 reason = Timeout
118962025-08-01T16:10:29.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
118972025-08-01T16:10:29.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
118982025-08-01T16:10:29.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
118992025-08-01T16:10:29.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
119002025-08-01T16:10:29.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
119012025-08-01T16:10:29.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119022025-08-01T16:10:29.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119032025-08-01T16:10:29.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119042025-08-01T16:10:29.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119052025-08-01T16:10:29.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119062025-08-01T16:10:29.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119072025-08-01T16:10:29.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
119082025-08-01T16:10:29.765ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
119092025-08-01T16:10:29.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
119102025-08-01T16:10:29.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
119112025-08-01T16:10:29.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119122025-08-01T16:10:29.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119132025-08-01T16:10:29.767ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
119142025-08-01T16:10:29.767ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.514079ms iteration = 153 status = {"chicken_switches_updated":false}
119152025-08-01T16:10:29.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119162025-08-01T16:10:29.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119172025-08-01T16:10:29.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119182025-08-01T16:10:29.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
119192025-08-01T16:10:29.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119202025-08-01T16:10:29.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119212025-08-01T16:10:29.793ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
119222025-08-01T16:10:29.793ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 33.978891ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
119232025-08-01T16:10:29.803ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 44.687845ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
119242025-08-01T16:10:29.919ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 640 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 0cb408d9-1ab1-429f-9f51-972e5d6f4bdd response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
119252025-08-01T16:10:30.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cb40141b-6396-4f89-8f27-9df4a415830e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119262025-08-01T16:10:30.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cb40141b-6396-4f89-8f27-9df4a415830e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119272025-08-01T16:10:30.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2333 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cb40141b-6396-4f89-8f27-9df4a415830e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119282025-08-01T16:10:31.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 437788f2-9569-435a-8787-f1749d1d1b5d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119292025-08-01T16:10:31.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 437788f2-9569-435a-8787-f1749d1d1b5d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119302025-08-01T16:10:31.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2529 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 437788f2-9569-435a-8787-f1749d1d1b5d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119312025-08-01T16:10:32.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 66f810f0-a64d-4c41-ac7f-d8e0d58f14d0 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119322025-08-01T16:10:32.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 66f810f0-a64d-4c41-ac7f-d8e0d58f14d0 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119332025-08-01T16:10:32.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2647 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 66f810f0-a64d-4c41-ac7f-d8e0d58f14d0 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119342025-08-01T16:10:33.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a575e177-d42c-435f-af67-5386d4fcc4d8 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119352025-08-01T16:10:33.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a575e177-d42c-435f-af67-5386d4fcc4d8 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119362025-08-01T16:10:33.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2797 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a575e177-d42c-435f-af67-5386d4fcc4d8 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119372025-08-01T16:10:34.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 042055ce-8095-48fc-82e7-e4f2b2e5f1ce roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119382025-08-01T16:10:34.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 042055ce-8095-48fc-82e7-e4f2b2e5f1ce resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119392025-08-01T16:10:34.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2437 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 042055ce-8095-48fc-82e7-e4f2b2e5f1ce response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119402025-08-01T16:10:34.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 154 reason = Timeout
119412025-08-01T16:10:34.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
119422025-08-01T16:10:34.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
119432025-08-01T16:10:34.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119442025-08-01T16:10:34.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
119452025-08-01T16:10:34.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
119462025-08-01T16:10:34.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
119472025-08-01T16:10:34.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
119482025-08-01T16:10:34.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.154047ms iteration = 154 status = {"chicken_switches_updated":false}
119492025-08-01T16:10:35.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 563495da-a164-46a4-bc93-4981fc98a7ed roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119502025-08-01T16:10:35.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 563495da-a164-46a4-bc93-4981fc98a7ed resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119512025-08-01T16:10:35.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2710 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 563495da-a164-46a4-bc93-4981fc98a7ed response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119522025-08-01T16:10:36.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e55261d3-7943-4684-99ee-e9ab4ffccce7 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119532025-08-01T16:10:36.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e55261d3-7943-4684-99ee-e9ab4ffccce7 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119542025-08-01T16:10:36.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2432 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e55261d3-7943-4684-99ee-e9ab4ffccce7 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119552025-08-01T16:10:37.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2c25f7ec-a4a0-4ace-88c1-926c0328ac02 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119562025-08-01T16:10:37.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2c25f7ec-a4a0-4ace-88c1-926c0328ac02 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119572025-08-01T16:10:37.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2390 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2c25f7ec-a4a0-4ace-88c1-926c0328ac02 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119582025-08-01T16:10:38.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 32657752-c185-4ca6-a46d-30e885b2bc46 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119592025-08-01T16:10:38.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 32657752-c185-4ca6-a46d-30e885b2bc46 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119602025-08-01T16:10:38.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2604 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 32657752-c185-4ca6-a46d-30e885b2bc46 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119612025-08-01T16:10:39.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 309a6d1a-98b5-4622-9245-43c0fb000545 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119622025-08-01T16:10:39.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 309a6d1a-98b5-4622-9245-43c0fb000545 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119632025-08-01T16:10:39.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2370 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 309a6d1a-98b5-4622-9245-43c0fb000545 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119642025-08-01T16:10:39.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
119652025-08-01T16:10:39.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 155 reason = Timeout
119662025-08-01T16:10:39.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119672025-08-01T16:10:39.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
119682025-08-01T16:10:39.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
119692025-08-01T16:10:39.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119702025-08-01T16:10:39.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
119712025-08-01T16:10:39.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119722025-08-01T16:10:39.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119732025-08-01T16:10:39.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119742025-08-01T16:10:39.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119752025-08-01T16:10:39.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119762025-08-01T16:10:39.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119772025-08-01T16:10:39.763ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.527267ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
119782025-08-01T16:10:39.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
119792025-08-01T16:10:39.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
119802025-08-01T16:10:39.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
119812025-08-01T16:10:39.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
119822025-08-01T16:10:39.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119832025-08-01T16:10:39.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119842025-08-01T16:10:39.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
119852025-08-01T16:10:39.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.443795ms iteration = 155 status = {"chicken_switches_updated":false}
119862025-08-01T16:10:39.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119872025-08-01T16:10:39.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119882025-08-01T16:10:39.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119892025-08-01T16:10:39.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
119902025-08-01T16:10:39.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119912025-08-01T16:10:39.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119922025-08-01T16:10:39.783ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
119932025-08-01T16:10:39.783ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.522583ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
119942025-08-01T16:10:39.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 658 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 24d268c0-91e5-4e47-b37d-3c599e32e7e8 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
119952025-08-01T16:10:40.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bf2f1b41-bd0a-4d9c-b162-a87a99011e50 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119962025-08-01T16:10:40.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bf2f1b41-bd0a-4d9c-b162-a87a99011e50 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119972025-08-01T16:10:40.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2541 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bf2f1b41-bd0a-4d9c-b162-a87a99011e50 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119982025-08-01T16:10:41.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ef97b6d5-4dfc-49c8-878e-92e29e081797 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
119992025-08-01T16:10:41.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ef97b6d5-4dfc-49c8-878e-92e29e081797 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
120002025-08-01T16:10:41.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2427 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ef97b6d5-4dfc-49c8-878e-92e29e081797 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
120012025-08-01T16:10:42.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f99386bd-618e-437b-8dae-41abe184fcea roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
120022025-08-01T16:10:42.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f99386bd-618e-437b-8dae-41abe184fcea resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
120032025-08-01T16:10:42.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2805 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f99386bd-618e-437b-8dae-41abe184fcea response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
120042025-08-01T16:10:43.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0cd52e56-afa5-4c3b-be41-946e65de9e3b roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
120052025-08-01T16:10:43.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0cd52e56-afa5-4c3b-be41-946e65de9e3b resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
120062025-08-01T16:10:43.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2560 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0cd52e56-afa5-4c3b-be41-946e65de9e3b response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
120072025-08-01T16:10:44.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 780076ba-363e-4412-a7e1-19e31a912f96 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
120082025-08-01T16:10:44.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 780076ba-363e-4412-a7e1-19e31a912f96 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
120092025-08-01T16:10:44.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2262 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 780076ba-363e-4412-a7e1-19e31a912f96 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
120102025-08-01T16:10:44.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 156 reason = Timeout
120112025-08-01T16:10:44.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
120122025-08-01T16:10:44.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
120132025-08-01T16:10:44.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120142025-08-01T16:10:44.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
120152025-08-01T16:10:44.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
120162025-08-01T16:10:44.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
120172025-08-01T16:10:44.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
120182025-08-01T16:10:44.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.045514ms iteration = 156 status = {"chicken_switches_updated":false}
120192025-08-01T16:10:45.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 46e8f750-3e45-4167-9025-d8bf95dda669 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
120202025-08-01T16:10:45.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 46e8f750-3e45-4167-9025-d8bf95dda669 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
120212025-08-01T16:10:45.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2226 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 46e8f750-3e45-4167-9025-d8bf95dda669 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
120222025-08-01T16:10:46.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2efae90e-68b2-40ad-8e46-a865ed43ca96 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
120232025-08-01T16:10:46.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2efae90e-68b2-40ad-8e46-a865ed43ca96 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
120242025-08-01T16:10:46.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2435 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2efae90e-68b2-40ad-8e46-a865ed43ca96 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
120252025-08-01T16:10:47.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b38b91fe-474a-4294-bbe3-f80fc0e2e932 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
120262025-08-01T16:10:47.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b38b91fe-474a-4294-bbe3-f80fc0e2e932 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
120272025-08-01T16:10:47.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1998 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b38b91fe-474a-4294-bbe3-f80fc0e2e932 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
120282025-08-01T16:10:48.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f57fb9d9-cb8d-492e-a8dd-f55cd38d67fa roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
120292025-08-01T16:10:48.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f57fb9d9-cb8d-492e-a8dd-f55cd38d67fa resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
120302025-08-01T16:10:48.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2660 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f57fb9d9-cb8d-492e-a8dd-f55cd38d67fa response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
120312025-08-01T16:10:49.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1c0f7eb9-c1ab-4ad9-a351-3f4de8a7b885 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
120322025-08-01T16:10:49.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1c0f7eb9-c1ab-4ad9-a351-3f4de8a7b885 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
120332025-08-01T16:10:49.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2470 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1c0f7eb9-c1ab-4ad9-a351-3f4de8a7b885 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
120342025-08-01T16:10:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
120352025-08-01T16:10:49.687ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
120362025-08-01T16:10:49.687ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
120372025-08-01T16:10:49.687ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
120382025-08-01T16:10:49.687ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-01 16:00:49.687607204 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
120392025-08-01T16:10:49.687ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
120402025-08-01T16:10:49.687ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
120412025-08-01T16:10:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
120422025-08-01T16:10:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
120432025-08-01T16:10:49.687ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
120442025-08-01T16:10:49.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
120452025-08-01T16:10:49.687ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
120462025-08-01T16:10:49.687ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
120472025-08-01T16:10:49.687ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
120482025-08-01T16:10:49.687ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
120492025-08-01T16:10:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
120502025-08-01T16:10:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
120512025-08-01T16:10:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
120522025-08-01T16:10:49.687ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
120532025-08-01T16:10:49.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
120542025-08-01T16:10:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
120552025-08-01T16:10:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
120562025-08-01T16:10:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
120572025-08-01T16:10:49.688ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50fe31de-3241-42df-a386-de37ce323a34.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("58598327-8751-423c-a5ac-c610829651e2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 44345, tv_nsec: 705118645 } })
120582025-08-01T16:10:49.688ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cb706a84-a33b-442f-aac2-3a6eb5f3b330.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d688a68d-d771-4ac5-8e66-9efa94dbbea8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d688a68d-d771-4ac5-8e66-9efa94dbbea8.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 44345, tv_nsec: 705130635 } })
120592025-08-01T16:10:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
120602025-08-01T16:10:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
120612025-08-01T16:10:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
120622025-08-01T16:10:49.688ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
120632025-08-01T16:10:49.688ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.076183ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
120642025-08-01T16:10:49.688ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
120652025-08-01T16:10:49.688ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.110914ms iteration = 14 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
120662025-08-01T16:10:49.690ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
120672025-08-01T16:10:49.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
120682025-08-01T16:10:49.691ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120692025-08-01T16:10:49.691ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
120702025-08-01T16:10:49.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
120712025-08-01T16:10:49.692ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-01 16:00:49.687607204 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
120722025-08-01T16:10:49.692ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.61402ms iteration = 14 status = {"expiration":"2025-08-01T16:00:49.687607204Z","pruned":[]}
120732025-08-01T16:10:49.692ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.012472ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
120742025-08-01T16:10:49.693ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44345, tv_nsec: 710445077 } })
120752025-08-01T16:10:49.693ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
120762025-08-01T16:10:49.694ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44345, tv_nsec: 711444127 } })
120772025-08-01T16:10:49.694ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
120782025-08-01T16:10:49.694ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
120792025-08-01T16:10:49.694ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
120802025-08-01T16:10:49.694ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120812025-08-01T16:10:49.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
120822025-08-01T16:10:49.697ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
120832025-08-01T16:10:49.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
120842025-08-01T16:10:49.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
120852025-08-01T16:10:49.699ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120862025-08-01T16:10:49.700ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
120872025-08-01T16:10:49.700ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
120882025-08-01T16:10:49.700ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
120892025-08-01T16:10:49.700ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
120902025-08-01T16:10:49.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
120912025-08-01T16:10:49.702ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120922025-08-01T16:10:49.703ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
120932025-08-01T16:10:49.703ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
120942025-08-01T16:10:49.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
120952025-08-01T16:10:49.705ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
120962025-08-01T16:10:49.705ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1
120972025-08-01T16:10:49.705ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 22.87\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1"}
120982025-08-01T16:10:49.707ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
120992025-08-01T16:10:49.707ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
121002025-08-01T16:10:49.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
121012025-08-01T16:10:49.708ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 18 reason = Timeout
121022025-08-01T16:10:49.708ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
121032025-08-01T16:10:49.708ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 15.861\u{b5}s iteration = 18 status = "Disabled"
121042025-08-01T16:10:49.710ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 14 reason = Timeout
121052025-08-01T16:10:49.710ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
121062025-08-01T16:10:49.710ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
121072025-08-01T16:10:49.710ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
121082025-08-01T16:10:49.710ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
121092025-08-01T16:10:49.710ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
121102025-08-01T16:10:49.710ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
121112025-08-01T16:10:49.710ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 14 reason = Timeout
121122025-08-01T16:10:49.710ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
121132025-08-01T16:10:49.710ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
121142025-08-01T16:10:49.710ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
121152025-08-01T16:10:49.710ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
121162025-08-01T16:10:49.710ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
121172025-08-01T16:10:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
121182025-08-01T16:10:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
121192025-08-01T16:10:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
121202025-08-01T16:10:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
121212025-08-01T16:10:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
121222025-08-01T16:10:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
121232025-08-01T16:10:49.712ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
121242025-08-01T16:10:49.712ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 2.397803ms iteration = 14 status = {"by_rx":{},"error":null}
121252025-08-01T16:10:49.713ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121262025-08-01T16:10:49.714ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.28401ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
121272025-08-01T16:10:49.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
121282025-08-01T16:10:49.716ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
121292025-08-01T16:10:49.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
121302025-08-01T16:10:49.717ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
121312025-08-01T16:10:49.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
121322025-08-01T16:10:49.720ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 9.659143ms iteration = 14 status = {"dispatched":[],"errors":[],"glob_version":"173.0.0","globs_reprocessed":{},"no_receivers":[]}
121332025-08-01T16:10:49.745ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121342025-08-01T16:10:49.749ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
121352025-08-01T16:10:49.749ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 02fcb774-aa43-4052-9996-b85e2d1358b5 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
121362025-08-01T16:10:49.749ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
121372025-08-01T16:10:49.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
121382025-08-01T16:10:49.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
121392025-08-01T16:10:49.751ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121402025-08-01T16:10:49.753ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
121412025-08-01T16:10:49.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
121422025-08-01T16:10:49.755ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
121432025-08-01T16:10:49.755ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
121442025-08-01T16:10:49.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
121452025-08-01T16:10:49.756ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
121462025-08-01T16:10:49.756ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
121472025-08-01T16:10:49.756ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 46.15459ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
121482025-08-01T16:10:49.757ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 02fcb774-aa43-4052-9996-b85e2d1358b5 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
121492025-08-01T16:10:49.757ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
121502025-08-01T16:10:49.757ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-01 15:58:34.032744 UTC dns_group = internal generation = 1
121512025-08-01T16:10:49.757ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 69.776256ms iteration = 14 status = {"generation":1}
121522025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 27 reason = Timeout
121532025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
121542025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
121552025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
121562025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
121572025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 23.21\u{b5}s iteration = 27 status = {"disabled":true,"errors":[],"sps":[]}
121582025-08-01T16:10:49.758ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
121592025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 157 reason = Timeout
121602025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
121612025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121622025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
121632025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
121642025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
121652025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
121662025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
121672025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 27 reason = Timeout
121682025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
121692025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
121702025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
121712025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
121722025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
121732025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
121742025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
121752025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
121762025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
121772025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
121782025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
121792025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
121802025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
121812025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121822025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
121832025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
121842025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
121852025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
121862025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 27 reason = Timeout
121872025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
121882025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
121892025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121902025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
121912025-08-01T16:10:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121922025-08-01T16:10:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
121932025-08-01T16:10:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
121942025-08-01T16:10:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
121952025-08-01T16:10:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
121962025-08-01T16:10:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
121972025-08-01T16:10:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
121982025-08-01T16:10:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
121992025-08-01T16:10:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
122002025-08-01T16:10:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122012025-08-01T16:10:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
122022025-08-01T16:10:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
122032025-08-01T16:10:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122042025-08-01T16:10:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
122052025-08-01T16:10:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
122062025-08-01T16:10:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122072025-08-01T16:10:49.761ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
122082025-08-01T16:10:49.761ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
122092025-08-01T16:10:49.761ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
122102025-08-01T16:10:49.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
122112025-08-01T16:10:49.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122122025-08-01T16:10:49.763ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122132025-08-01T16:10:49.765ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122142025-08-01T16:10:49.766ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
122152025-08-01T16:10:49.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
122162025-08-01T16:10:49.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
122172025-08-01T16:10:49.767ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
122182025-08-01T16:10:49.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
122192025-08-01T16:10:49.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
122202025-08-01T16:10:49.772ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
122212025-08-01T16:10:49.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
122222025-08-01T16:10:49.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
122232025-08-01T16:10:49.773ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
122242025-08-01T16:10:49.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122252025-08-01T16:10:49.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122262025-08-01T16:10:49.776ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122272025-08-01T16:10:49.779ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
122282025-08-01T16:10:49.779ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 21.003937ms iteration = 157 status = {"chicken_switches_updated":false}
122292025-08-01T16:10:49.780ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
122302025-08-01T16:10:49.780ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
122312025-08-01T16:10:49.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122322025-08-01T16:10:49.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
122332025-08-01T16:10:49.781ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
122342025-08-01T16:10:49.781ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122352025-08-01T16:10:49.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122362025-08-01T16:10:49.781ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
122372025-08-01T16:10:49.781ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
122382025-08-01T16:10:49.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
122392025-08-01T16:10:49.785ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122402025-08-01T16:10:49.785ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 26.448772ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
122412025-08-01T16:10:49.785ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122422025-08-01T16:10:49.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122432025-08-01T16:10:49.786ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
122442025-08-01T16:10:49.786ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
122452025-08-01T16:10:49.786ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 76.351315ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
122462025-08-01T16:10:49.787ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122472025-08-01T16:10:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
122482025-08-01T16:10:49.788ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
122492025-08-01T16:10:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122502025-08-01T16:10:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
122512025-08-01T16:10:49.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122522025-08-01T16:10:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122532025-08-01T16:10:49.796ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
122542025-08-01T16:10:49.797ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
122552025-08-01T16:10:49.797ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
122562025-08-01T16:10:49.798ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ab4550c-c42c-403a-920e-4b9308efa9f9", "content-length": "26", "date": "Fri, 01 Aug 2025 16:10:49 GMT"} })
122572025-08-01T16:10:49.798ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
122582025-08-01T16:10:49.799ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
122592025-08-01T16:10:49.802ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
122602025-08-01T16:10:49.803ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
122612025-08-01T16:10:49.803ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
122622025-08-01T16:10:49.803ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
122632025-08-01T16:10:49.803ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
122642025-08-01T16:10:49.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
122652025-08-01T16:10:49.806ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122662025-08-01T16:10:49.808ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122672025-08-01T16:10:49.811ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
122682025-08-01T16:10:49.811ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
122692025-08-01T16:10:49.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
122702025-08-01T16:10:49.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
122712025-08-01T16:10:49.812ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
122722025-08-01T16:10:49.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
122732025-08-01T16:10:49.812ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122742025-08-01T16:10:49.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122752025-08-01T16:10:49.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122762025-08-01T16:10:49.813ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
122772025-08-01T16:10:49.813ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.997818ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
122782025-08-01T16:10:49.815ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.550044ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
122792025-08-01T16:10:49.817ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
122802025-08-01T16:10:49.817ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122812025-08-01T16:10:49.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122822025-08-01T16:10:49.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122832025-08-01T16:10:49.823ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
122842025-08-01T16:10:49.823ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122852025-08-01T16:10:49.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122862025-08-01T16:10:49.827ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
122872025-08-01T16:10:49.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
122882025-08-01T16:10:49.829ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 70.790207ms iteration = 27 status = {"errors":[],"requests_created_ok":[]}
122892025-08-01T16:10:49.835ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
122902025-08-01T16:10:49.835ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
122912025-08-01T16:10:49.835ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7bc07dd7-bbd3-439a-869f-db87f62b3c9b", "content-length": "26", "date": "Fri, 01 Aug 2025 16:10:49 GMT"} })
122922025-08-01T16:10:49.835ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
122932025-08-01T16:10:49.836ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 77.613513ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
122942025-08-01T16:10:49.836ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122952025-08-01T16:10:49.838ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
122962025-08-01T16:10:49.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
122972025-08-01T16:10:49.841ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122982025-08-01T16:10:49.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122992025-08-01T16:10:49.852ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 93.656789ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
123002025-08-01T16:10:49.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123012025-08-01T16:10:49.852ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
123022025-08-01T16:10:49.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
123032025-08-01T16:10:49.853ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123042025-08-01T16:10:49.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123052025-08-01T16:10:49.853ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
123062025-08-01T16:10:49.854ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
123072025-08-01T16:10:49.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
123082025-08-01T16:10:49.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
123092025-08-01T16:10:49.855ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123102025-08-01T16:10:49.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
123112025-08-01T16:10:49.856ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123122025-08-01T16:10:49.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123132025-08-01T16:10:49.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
123142025-08-01T16:10:49.859ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
123152025-08-01T16:10:49.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
123162025-08-01T16:10:49.860ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44345, tv_nsec: 877243754 } })
123172025-08-01T16:10:49.860ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
123182025-08-01T16:10:49.860ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
123192025-08-01T16:10:49.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
123202025-08-01T16:10:49.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 104.350134ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
123212025-08-01T16:10:49.863ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
123222025-08-01T16:10:49.863ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 104.789048ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
123232025-08-01T16:10:49.870ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 112.10357ms iteration = 30 status = {"physical_disks_added":0}
123242025-08-01T16:10:49.877ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
123252025-08-01T16:10:49.877ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6482e44c-c860-4033-b945-5707d343a59d dns_zone_name = oxide.test found_so_far = 0 version = 2
123262025-08-01T16:10:49.877ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
123272025-08-01T16:10:49.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
123282025-08-01T16:10:49.883ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123292025-08-01T16:10:49.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
123302025-08-01T16:10:49.887ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
123312025-08-01T16:10:49.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
123322025-08-01T16:10:49.891ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6482e44c-c860-4033-b945-5707d343a59d dns_zone_name = oxide.test found_so_far = 4 version = 2
123332025-08-01T16:10:49.891ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
123342025-08-01T16:10:49.891ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-01 15:58:34.713515 UTC dns_group = external generation = 2
123352025-08-01T16:10:49.891ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 203.401847ms iteration = 14 status = {"generation":2}
123362025-08-01T16:10:49.894ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-01T15:57:44.766264Z, time_modified: 2025-08-01T15:57:44.766264Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: eec17da7-eb17-4917-8728-908698b69bbe, db_silo: Silo { identity: SiloIdentity { id: eec17da7-eb17-4917-8728-908698b69bbe, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-01T15:58:34.653875Z, time_modified: 2025-08-01T15:58:34.653875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: eec17da7-eb17-4917-8728-908698b69bbe, db_silo: Silo { identity: SiloIdentity { id: eec17da7-eb17-4917-8728-908698b69bbe, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-01T15:58:34.653875Z, time_modified: 2025-08-01T15:58:34.653875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575" }] }) }
123372025-08-01T16:10:49.894ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 207.214033ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"eec17da7-eb17-4917-8728-908698b69bbe","tls_certs":["b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575"]}},"default_endpoint":{"silo_id":"eec17da7-eb17-4917-8728-908698b69bbe","tls_certs":["b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
123382025-08-01T16:10:49.906ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
123392025-08-01T16:10:49.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
123402025-08-01T16:10:49.908ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 150.374039ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
123412025-08-01T16:10:49.912ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:391
123422025-08-01T16:10:49.912ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 153.764403ms iteration = 27 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
123432025-08-01T16:10:49.917ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
123442025-08-01T16:10:49.917ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
123452025-08-01T16:10:49.917ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 159.185157ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
123462025-08-01T16:10:49.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1023 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = adc426b5-95c6-4d15-920f-71de306a909c response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
123472025-08-01T16:10:49.921ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123482025-08-01T16:10:49.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123492025-08-01T16:10:49.923ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123502025-08-01T16:10:49.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123512025-08-01T16:10:49.926ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123522025-08-01T16:10:49.931ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
123532025-08-01T16:10:49.931ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123542025-08-01T16:10:49.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123552025-08-01T16:10:49.937ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 178.489022ms iteration = 27 status = 0
123562025-08-01T16:10:49.939ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
123572025-08-01T16:10:49.940ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3a54ebbd-1a54-4461-ab84-56143d8602d3", "date": "Fri, 01 Aug 2025 16:10:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
123582025-08-01T16:10:49.940ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
123592025-08-01T16:10:49.941ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "06830b77-0475-4585-a321-1425564c33d6", "date": "Fri, 01 Aug 2025 16:10:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
123602025-08-01T16:10:49.941ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
123612025-08-01T16:10:49.943ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
123622025-08-01T16:10:49.943ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 255.785156ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
123632025-08-01T16:10:49.967ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
123642025-08-01T16:10:49.967ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 256.826367ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
123652025-08-01T16:10:49.975ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
123662025-08-01T16:10:49.975ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123672025-08-01T16:10:49.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123682025-08-01T16:10:50.000ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 313.103023ms iteration = 27 status = {}
123692025-08-01T16:10:50.001ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
123702025-08-01T16:10:50.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
123712025-08-01T16:10:50.003ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 315.92673ms iteration = 27 status = null
123722025-08-01T16:10:50.035ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 zone_address = fd00:1122:3344:101::2
123732025-08-01T16:10:50.035ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
123742025-08-01T16:10:50.035ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea081732-01e3-4ddc-801f-26575709a007", "content-length": "26", "date": "Fri, 01 Aug 2025 16:10:49 GMT"} })
123752025-08-01T16:10:50.035ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
123762025-08-01T16:10:50.037ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
123772025-08-01T16:10:50.049ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
123782025-08-01T16:10:50.049ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
123792025-08-01T16:10:50.049ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "18c095ee-6503-4544-b323-ebd22138fc98", "content-length": "372", "date": "Fri, 01 Aug 2025 16:10:50 GMT"} })
123802025-08-01T16:10:50.049ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123812025-08-01T16:10:50.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123822025-08-01T16:10:50.056ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
123832025-08-01T16:10:50.057ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a73d7e6c-f5cd-4aea-b4be-15edd0eb672f", "date": "Fri, 01 Aug 2025 16:10:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
123842025-08-01T16:10:50.057ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
123852025-08-01T16:10:50.058ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "35c8f740-5777-425d-973e-6fbabebf5a0e", "date": "Fri, 01 Aug 2025 16:10:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
123862025-08-01T16:10:50.058ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
123872025-08-01T16:10:50.060ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "905a0de8-a8e6-4e93-83dd-268d12b719ff", "date": "Fri, 01 Aug 2025 16:10:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
123882025-08-01T16:10:50.060ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
123892025-08-01T16:10:50.062ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
123902025-08-01T16:10:50.062ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 374.34281ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
123912025-08-01T16:10:50.065ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
123922025-08-01T16:10:50.065ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
123932025-08-01T16:10:50.065ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d989fbe3-17b1-4619-85fd-5dff797b9fae", "date": "Fri, 01 Aug 2025 16:10:50 GMT"} })
123942025-08-01T16:10:50.065ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123952025-08-01T16:10:50.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123962025-08-01T16:10:50.067ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123972025-08-01T16:10:50.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123982025-08-01T16:10:50.070ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123992025-08-01T16:10:50.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124002025-08-01T16:10:50.072ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
124012025-08-01T16:10:50.073ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
124022025-08-01T16:10:50.073ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b0ab9c3a-7e83-4fcb-8f1b-7481e9b87ebe", "date": "Fri, 01 Aug 2025 16:10:50 GMT"} })
124032025-08-01T16:10:50.075ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 316.886668ms iteration = 28 status = {}
124042025-08-01T16:10:50.105ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124052025-08-01T16:10:50.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124062025-08-01T16:10:50.106ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124072025-08-01T16:10:50.109ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
124082025-08-01T16:10:50.109ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124092025-08-01T16:10:50.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124102025-08-01T16:10:50.110ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124112025-08-01T16:10:50.112ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
124122025-08-01T16:10:50.112ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124132025-08-01T16:10:50.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124142025-08-01T16:10:50.163ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124152025-08-01T16:10:50.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124162025-08-01T16:10:50.166ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 3f21d9d5-3adf-463a-a05d-bc2e2e5d64ca, rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(4c7da70d-ede0-4107-abc5-5650a053be38) } rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
124172025-08-01T16:10:50.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124182025-08-01T16:10:50.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124192025-08-01T16:10:50.170ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
124202025-08-01T16:10:50.170ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7fe1a36b-7243-411c-9390-f9f07d4f20a2", "content-length": "691", "date": "Fri, 01 Aug 2025 16:10:50 GMT"} })
124212025-08-01T16:10:50.170ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
124222025-08-01T16:10:50.170ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
124232025-08-01T16:10:50.170ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
124242025-08-01T16:10:50.172ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 414.143957ms iteration = 28 status = {}
124252025-08-01T16:10:50.179ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
124262025-08-01T16:10:50.179ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 4c7da70d-ede0-4107-abc5-5650a053be38
124272025-08-01T16:10:50.179ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
124282025-08-01T16:10:50.179ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
124292025-08-01T16:10:50.179ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124302025-08-01T16:10:50.179ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124312025-08-01T16:10:50.179ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124322025-08-01T16:10:50.179ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
124332025-08-01T16:10:50.179ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124342025-08-01T16:10:50.179ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
124352025-08-01T16:10:50.179ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
124362025-08-01T16:10:50.179ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124372025-08-01T16:10:50.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124382025-08-01T16:10:50.182ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
124392025-08-01T16:10:50.182ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
124402025-08-01T16:10:50.315ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "92b67fe6-c501-4347-8229-42dcdf38b19d", "date": "Fri, 01 Aug 2025 16:10:49 GMT"} })
124412025-08-01T16:10:50.315ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch = Switch0
124422025-08-01T16:10:50.315ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
124432025-08-01T16:10:50.315ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5bb5b942-99dc-4eed-b8c8-879e0b7b65c0", "content-length": "682", "date": "Fri, 01 Aug 2025 16:10:50 GMT"} })
124442025-08-01T16:10:50.315ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124452025-08-01T16:10:50.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124462025-08-01T16:10:50.319ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124472025-08-01T16:10:50.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124482025-08-01T16:10:50.323ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124492025-08-01T16:10:50.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124502025-08-01T16:10:50.325ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124512025-08-01T16:10:50.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124522025-08-01T16:10:50.333ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 574.574272ms iteration = 27 status = {}
124532025-08-01T16:10:50.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1d436d65-5bfe-417b-8b05-729e643bd552 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124542025-08-01T16:10:50.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1d436d65-5bfe-417b-8b05-729e643bd552 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124552025-08-01T16:10:50.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2049 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1d436d65-5bfe-417b-8b05-729e643bd552 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124562025-08-01T16:10:51.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ca18ec00-a499-419c-a932-ac8b708b18a6 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124572025-08-01T16:10:51.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ca18ec00-a499-419c-a932-ac8b708b18a6 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124582025-08-01T16:10:51.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2284 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ca18ec00-a499-419c-a932-ac8b708b18a6 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124592025-08-01T16:10:52.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f4710302-478c-4fea-8c5d-2f211b1778ef roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124602025-08-01T16:10:52.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f4710302-478c-4fea-8c5d-2f211b1778ef resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124612025-08-01T16:10:52.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2072 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f4710302-478c-4fea-8c5d-2f211b1778ef response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124622025-08-01T16:10:53.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = de228a01-c2d6-4ec7-b21f-db91379fae09 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124632025-08-01T16:10:53.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = de228a01-c2d6-4ec7-b21f-db91379fae09 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124642025-08-01T16:10:53.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2652 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = de228a01-c2d6-4ec7-b21f-db91379fae09 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124652025-08-01T16:10:54.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bc7523b3-bd06-47c8-ab01-fb160fd085eb roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124662025-08-01T16:10:54.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bc7523b3-bd06-47c8-ab01-fb160fd085eb resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124672025-08-01T16:10:54.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2894 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bc7523b3-bd06-47c8-ab01-fb160fd085eb response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124682025-08-01T16:10:54.757ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 158 reason = Timeout
124692025-08-01T16:10:54.757ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
124702025-08-01T16:10:54.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
124712025-08-01T16:10:54.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124722025-08-01T16:10:54.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
124732025-08-01T16:10:54.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
124742025-08-01T16:10:54.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
124752025-08-01T16:10:54.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
124762025-08-01T16:10:54.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.734414ms iteration = 158 status = {"chicken_switches_updated":false}
124772025-08-01T16:10:55.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3363d8da-9625-47fe-b80e-ceaa7671aa4f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124782025-08-01T16:10:55.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3363d8da-9625-47fe-b80e-ceaa7671aa4f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124792025-08-01T16:10:55.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2000 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3363d8da-9625-47fe-b80e-ceaa7671aa4f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124802025-08-01T16:10:56.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0d09fb7e-42ad-4db0-856e-b34c352b24a0 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124812025-08-01T16:10:56.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0d09fb7e-42ad-4db0-856e-b34c352b24a0 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124822025-08-01T16:10:56.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2355 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0d09fb7e-42ad-4db0-856e-b34c352b24a0 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124832025-08-01T16:10:57.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9575f837-f584-419a-b404-f6d4165300aa roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124842025-08-01T16:10:57.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9575f837-f584-419a-b404-f6d4165300aa resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124852025-08-01T16:10:57.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2352 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9575f837-f584-419a-b404-f6d4165300aa response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124862025-08-01T16:10:58.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e16dc348-6d2f-404a-9e6b-68c764a9c451 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124872025-08-01T16:10:58.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e16dc348-6d2f-404a-9e6b-68c764a9c451 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124882025-08-01T16:10:58.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2509 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e16dc348-6d2f-404a-9e6b-68c764a9c451 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124892025-08-01T16:10:59.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a3a5e3de-ab15-4a7a-b8d7-18f58c16de8a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124902025-08-01T16:10:59.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a3a5e3de-ab15-4a7a-b8d7-18f58c16de8a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124912025-08-01T16:10:59.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2565 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a3a5e3de-ab15-4a7a-b8d7-18f58c16de8a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
124922025-08-01T16:10:59.757ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
124932025-08-01T16:10:59.757ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124942025-08-01T16:10:59.757ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 159 reason = Timeout
124952025-08-01T16:10:59.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
124962025-08-01T16:10:59.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
124972025-08-01T16:10:59.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
124982025-08-01T16:10:59.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
124992025-08-01T16:10:59.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125002025-08-01T16:10:59.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125012025-08-01T16:10:59.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125022025-08-01T16:10:59.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125032025-08-01T16:10:59.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
125042025-08-01T16:10:59.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
125052025-08-01T16:10:59.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
125062025-08-01T16:10:59.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
125072025-08-01T16:10:59.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125082025-08-01T16:10:59.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125092025-08-01T16:10:59.768ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
125102025-08-01T16:10:59.768ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 10.063595ms iteration = 159 status = {"chicken_switches_updated":false}
125112025-08-01T16:10:59.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125122025-08-01T16:10:59.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125132025-08-01T16:10:59.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125142025-08-01T16:10:59.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
125152025-08-01T16:10:59.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125162025-08-01T16:10:59.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125172025-08-01T16:10:59.792ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
125182025-08-01T16:10:59.792ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 33.740943ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
125192025-08-01T16:10:59.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
125202025-08-01T16:10:59.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
125212025-08-01T16:10:59.842ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 84.271085ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
125222025-08-01T16:10:59.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 687 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = f8d5517f-45c3-4dd6-807b-dcffe61d0932 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
125232025-08-01T16:11:00.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7aabb534-ff45-4fb7-916a-cf5b32ecb330 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125242025-08-01T16:11:00.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7aabb534-ff45-4fb7-916a-cf5b32ecb330 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125252025-08-01T16:11:00.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2852 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7aabb534-ff45-4fb7-916a-cf5b32ecb330 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125262025-08-01T16:11:01.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b2db6898-e31d-4eac-9811-54d147cf8b43 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125272025-08-01T16:11:01.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b2db6898-e31d-4eac-9811-54d147cf8b43 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125282025-08-01T16:11:01.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2246 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b2db6898-e31d-4eac-9811-54d147cf8b43 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125292025-08-01T16:11:02.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c9f4076b-4c1e-4f84-a015-670c72ef8e76 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125302025-08-01T16:11:02.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c9f4076b-4c1e-4f84-a015-670c72ef8e76 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125312025-08-01T16:11:02.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2293 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c9f4076b-4c1e-4f84-a015-670c72ef8e76 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125322025-08-01T16:11:03.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 858ec7f6-365c-48c6-a346-a3d72a40eb42 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125332025-08-01T16:11:03.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 858ec7f6-365c-48c6-a346-a3d72a40eb42 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125342025-08-01T16:11:03.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2591 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 858ec7f6-365c-48c6-a346-a3d72a40eb42 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125352025-08-01T16:11:04.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1f016dc7-e31c-4355-bb83-fa204ec126b6 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125362025-08-01T16:11:04.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1f016dc7-e31c-4355-bb83-fa204ec126b6 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125372025-08-01T16:11:04.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2693 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1f016dc7-e31c-4355-bb83-fa204ec126b6 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125382025-08-01T16:11:04.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 160 reason = Timeout
125392025-08-01T16:11:04.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
125402025-08-01T16:11:04.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
125412025-08-01T16:11:04.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125422025-08-01T16:11:04.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
125432025-08-01T16:11:04.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
125442025-08-01T16:11:04.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
125452025-08-01T16:11:04.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
125462025-08-01T16:11:04.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.676143ms iteration = 160 status = {"chicken_switches_updated":false}
125472025-08-01T16:11:05.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b1671825-5b86-4a1f-a7a2-63a85fb333b0 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125482025-08-01T16:11:05.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b1671825-5b86-4a1f-a7a2-63a85fb333b0 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125492025-08-01T16:11:05.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2264 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b1671825-5b86-4a1f-a7a2-63a85fb333b0 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125502025-08-01T16:11:06.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 15da207f-ac08-4dbd-bac1-8d94bc551b10 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125512025-08-01T16:11:06.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 15da207f-ac08-4dbd-bac1-8d94bc551b10 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125522025-08-01T16:11:06.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2576 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 15da207f-ac08-4dbd-bac1-8d94bc551b10 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125532025-08-01T16:11:07.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 281d7a9f-0f06-42b4-85d7-31d45141aaf2 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125542025-08-01T16:11:07.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 281d7a9f-0f06-42b4-85d7-31d45141aaf2 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125552025-08-01T16:11:07.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2482 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 281d7a9f-0f06-42b4-85d7-31d45141aaf2 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125562025-08-01T16:11:08.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8cdc29c8-d7fe-4219-8e17-633671243374 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125572025-08-01T16:11:08.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8cdc29c8-d7fe-4219-8e17-633671243374 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125582025-08-01T16:11:08.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2340 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8cdc29c8-d7fe-4219-8e17-633671243374 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125592025-08-01T16:11:09.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fab4122a-608e-47ea-b64d-02eb778ee440 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125602025-08-01T16:11:09.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fab4122a-608e-47ea-b64d-02eb778ee440 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125612025-08-01T16:11:09.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2555 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fab4122a-608e-47ea-b64d-02eb778ee440 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125622025-08-01T16:11:09.757ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
125632025-08-01T16:11:09.757ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 161 reason = Timeout
125642025-08-01T16:11:09.757ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
125652025-08-01T16:11:09.757ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
125662025-08-01T16:11:09.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
125672025-08-01T16:11:09.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
125682025-08-01T16:11:09.758ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
125692025-08-01T16:11:09.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125702025-08-01T16:11:09.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125712025-08-01T16:11:09.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
125722025-08-01T16:11:09.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
125732025-08-01T16:11:09.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125742025-08-01T16:11:09.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125752025-08-01T16:11:09.761ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.900308ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
125762025-08-01T16:11:09.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
125772025-08-01T16:11:09.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125782025-08-01T16:11:09.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
125792025-08-01T16:11:09.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
125802025-08-01T16:11:09.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125812025-08-01T16:11:09.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
125822025-08-01T16:11:09.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125832025-08-01T16:11:09.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125842025-08-01T16:11:09.768ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
125852025-08-01T16:11:09.768ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 10.659183ms iteration = 161 status = {"chicken_switches_updated":false}
125862025-08-01T16:11:09.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125872025-08-01T16:11:09.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
125882025-08-01T16:11:09.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125892025-08-01T16:11:09.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125902025-08-01T16:11:09.792ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
125912025-08-01T16:11:09.792ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 33.938379ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
125922025-08-01T16:11:09.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 811 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = b6f73660-bcc1-41b2-8988-8541fc1c4420 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
125932025-08-01T16:11:10.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 297981fd-7ff0-4331-842b-332bc4be0f0f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125942025-08-01T16:11:10.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 297981fd-7ff0-4331-842b-332bc4be0f0f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125952025-08-01T16:11:10.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2695 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 297981fd-7ff0-4331-842b-332bc4be0f0f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125962025-08-01T16:11:11.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1a43df1c-d5fd-4004-bbee-14435a04af37 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125972025-08-01T16:11:11.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1a43df1c-d5fd-4004-bbee-14435a04af37 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125982025-08-01T16:11:11.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2490 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1a43df1c-d5fd-4004-bbee-14435a04af37 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
125992025-08-01T16:11:12.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = eb8be5a2-38c4-44e2-a41b-0e5d41e85c14 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
126002025-08-01T16:11:12.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = eb8be5a2-38c4-44e2-a41b-0e5d41e85c14 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
126012025-08-01T16:11:12.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2225 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = eb8be5a2-38c4-44e2-a41b-0e5d41e85c14 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
126022025-08-01T16:11:13.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 666d4531-d58d-4e74-afce-4a043f6cd85f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
126032025-08-01T16:11:13.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 666d4531-d58d-4e74-afce-4a043f6cd85f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
126042025-08-01T16:11:13.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2557 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 666d4531-d58d-4e74-afce-4a043f6cd85f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
126052025-08-01T16:11:14.757ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 162 reason = Timeout
126062025-08-01T16:11:14.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
126072025-08-01T16:11:14.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
126082025-08-01T16:11:14.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126092025-08-01T16:11:14.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
126102025-08-01T16:11:14.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
126112025-08-01T16:11:14.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
126122025-08-01T16:11:14.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
126132025-08-01T16:11:14.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.128397ms iteration = 162 status = {"chicken_switches_updated":false}
126142025-08-01T16:11:14.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cb0562b5-deab-48bc-8109-481c6d8c17ed roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
126152025-08-01T16:11:14.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cb0562b5-deab-48bc-8109-481c6d8c17ed resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
126162025-08-01T16:11:14.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2407 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cb0562b5-deab-48bc-8109-481c6d8c17ed response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
126172025-08-01T16:11:15.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 95cde514-84ea-4ad1-8367-8d8c093912ea roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
126182025-08-01T16:11:15.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 95cde514-84ea-4ad1-8367-8d8c093912ea resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
126192025-08-01T16:11:15.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2198 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 95cde514-84ea-4ad1-8367-8d8c093912ea response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
126202025-08-01T16:11:16.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2d8f875e-7e33-4ef7-800b-bec2c520750e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
126212025-08-01T16:11:16.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2d8f875e-7e33-4ef7-800b-bec2c520750e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
126222025-08-01T16:11:16.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2805 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2d8f875e-7e33-4ef7-800b-bec2c520750e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
126232025-08-01T16:11:17.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8a6e5435-275f-4f40-8923-d4c472044133 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
126242025-08-01T16:11:17.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8a6e5435-275f-4f40-8923-d4c472044133 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
126252025-08-01T16:11:17.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2547 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8a6e5435-275f-4f40-8923-d4c472044133 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
126262025-08-01T16:11:18.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 62f09320-5e42-4f4e-bc34-9006963674d5 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
126272025-08-01T16:11:18.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 62f09320-5e42-4f4e-bc34-9006963674d5 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
126282025-08-01T16:11:18.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2752 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 62f09320-5e42-4f4e-bc34-9006963674d5 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
126292025-08-01T16:11:19.687ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
126302025-08-01T16:11:19.687ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
126312025-08-01T16:11:19.687ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
126322025-08-01T16:11:19.687ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
126332025-08-01T16:11:19.687ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
126342025-08-01T16:11:19.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
126352025-08-01T16:11:19.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
126362025-08-01T16:11:19.691ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44375, tv_nsec: 708246693 } })
126372025-08-01T16:11:19.691ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44375, tv_nsec: 708398967 } })
126382025-08-01T16:11:19.691ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
126392025-08-01T16:11:19.691ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
126402025-08-01T16:11:19.692ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.376343ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
126412025-08-01T16:11:19.753ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
126422025-08-01T16:11:19.753ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
126432025-08-01T16:11:19.753ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
126442025-08-01T16:11:19.753ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
126452025-08-01T16:11:19.753ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8589f7fe-9e7f-444b-afbf-9043af43f1b9", "content-length": "26", "date": "Fri, 01 Aug 2025 16:11:19 GMT"} })
126462025-08-01T16:11:19.753ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
126472025-08-01T16:11:19.753ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d4ce0d3-53e8-4ba1-9e67-62c13f20a653", "content-length": "26", "date": "Fri, 01 Aug 2025 16:11:19 GMT"} })
126482025-08-01T16:11:19.753ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
126492025-08-01T16:11:19.754ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
126502025-08-01T16:11:19.755ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
126512025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 28 reason = Timeout
126522025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 13.531\u{b5}s iteration = 28 status = {"disabled":true,"errors":[],"sps":[]}
126532025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
126542025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
126552025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
126562025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
126572025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
126582025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
126592025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
126602025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
126612025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
126622025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
126632025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
126642025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
126652025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126662025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
126672025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
126682025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
126692025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 163 reason = Timeout
126702025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
126712025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
126722025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
126732025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
126742025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
126752025-08-01T16:11:19.758ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
126762025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126772025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 28 reason = Timeout
126782025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
126792025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
126802025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
126812025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
126822025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126832025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
126842025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
126852025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 28 reason = Timeout
126862025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
126872025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
126882025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126892025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
126902025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
126912025-08-01T16:11:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
126922025-08-01T16:11:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
126932025-08-01T16:11:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
126942025-08-01T16:11:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126952025-08-01T16:11:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
126962025-08-01T16:11:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
126972025-08-01T16:11:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
126982025-08-01T16:11:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
126992025-08-01T16:11:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127002025-08-01T16:11:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
127012025-08-01T16:11:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127022025-08-01T16:11:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
127032025-08-01T16:11:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127042025-08-01T16:11:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
127052025-08-01T16:11:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
127062025-08-01T16:11:19.761ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.94709ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
127072025-08-01T16:11:19.761ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127082025-08-01T16:11:19.761ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
127092025-08-01T16:11:19.761ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
127102025-08-01T16:11:19.761ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
127112025-08-01T16:11:19.762ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127122025-08-01T16:11:19.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
127132025-08-01T16:11:19.764ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127142025-08-01T16:11:19.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
127152025-08-01T16:11:19.764ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
127162025-08-01T16:11:19.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
127172025-08-01T16:11:19.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
127182025-08-01T16:11:19.765ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
127192025-08-01T16:11:19.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
127202025-08-01T16:11:19.765ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127212025-08-01T16:11:19.766ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127222025-08-01T16:11:19.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127232025-08-01T16:11:19.767ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127242025-08-01T16:11:19.767ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
127252025-08-01T16:11:19.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
127262025-08-01T16:11:19.768ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127272025-08-01T16:11:19.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
127282025-08-01T16:11:19.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127292025-08-01T16:11:19.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127302025-08-01T16:11:19.769ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
127312025-08-01T16:11:19.769ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127322025-08-01T16:11:19.769ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
127332025-08-01T16:11:19.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127342025-08-01T16:11:19.769ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
127352025-08-01T16:11:19.769ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
127362025-08-01T16:11:19.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
127372025-08-01T16:11:19.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
127382025-08-01T16:11:19.770ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
127392025-08-01T16:11:19.770ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
127402025-08-01T16:11:19.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
127412025-08-01T16:11:19.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
127422025-08-01T16:11:19.770ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127432025-08-01T16:11:19.771ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127442025-08-01T16:11:19.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127452025-08-01T16:11:19.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
127462025-08-01T16:11:19.772ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
127472025-08-01T16:11:19.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
127482025-08-01T16:11:19.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
127492025-08-01T16:11:19.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127502025-08-01T16:11:19.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127512025-08-01T16:11:19.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
127522025-08-01T16:11:19.773ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
127532025-08-01T16:11:19.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
127542025-08-01T16:11:19.774ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44375, tv_nsec: 790895469 } })
127552025-08-01T16:11:19.774ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127562025-08-01T16:11:19.775ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
127572025-08-01T16:11:19.775ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127582025-08-01T16:11:19.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127592025-08-01T16:11:19.775ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
127602025-08-01T16:11:19.775ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
127612025-08-01T16:11:19.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
127622025-08-01T16:11:19.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
127632025-08-01T16:11:19.776ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
127642025-08-01T16:11:19.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
127652025-08-01T16:11:19.777ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127662025-08-01T16:11:19.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127672025-08-01T16:11:19.782ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
127682025-08-01T16:11:19.782ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 23.648807ms iteration = 163 status = {"chicken_switches_updated":false}
127692025-08-01T16:11:19.783ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127702025-08-01T16:11:19.786ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
127712025-08-01T16:11:19.786ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127722025-08-01T16:11:19.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127732025-08-01T16:11:19.804ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
127742025-08-01T16:11:19.804ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.742037ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
127752025-08-01T16:11:19.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 47.752058ms iteration = 28 status = {"errors":[],"finish_invoked_ok":[]}
127762025-08-01T16:11:19.808ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127772025-08-01T16:11:19.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127782025-08-01T16:11:19.810ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 52.293146ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
127792025-08-01T16:11:19.815ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
127802025-08-01T16:11:19.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
127812025-08-01T16:11:19.816ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
127822025-08-01T16:11:19.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
127832025-08-01T16:11:19.819ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 60.327979ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
127842025-08-01T16:11:19.819ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
127852025-08-01T16:11:19.819ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 60.897957ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
127862025-08-01T16:11:19.824ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
127872025-08-01T16:11:19.824ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
127882025-08-01T16:11:19.824ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 66.165636ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
127892025-08-01T16:11:19.826ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
127902025-08-01T16:11:19.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
127912025-08-01T16:11:19.828ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127922025-08-01T16:11:19.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127932025-08-01T16:11:19.829ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 70.446616ms iteration = 28 status = {"errors":[],"requests_created_ok":[]}
127942025-08-01T16:11:19.830ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 71.88632ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
127952025-08-01T16:11:19.830ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 71.786597ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
127962025-08-01T16:11:19.832ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127972025-08-01T16:11:19.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127982025-08-01T16:11:19.832ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
127992025-08-01T16:11:19.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
128002025-08-01T16:11:19.834ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128012025-08-01T16:11:19.835ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128022025-08-01T16:11:19.837ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 149.480822ms iteration = 28 status = {}
128032025-08-01T16:11:19.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
128042025-08-01T16:11:19.837ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
128052025-08-01T16:11:19.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
128062025-08-01T16:11:19.839ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
128072025-08-01T16:11:19.839ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128082025-08-01T16:11:19.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
128092025-08-01T16:11:19.846ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 87.894125ms iteration = 28 status = 0
128102025-08-01T16:11:19.857ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 98.514137ms iteration = 31 status = {"physical_disks_added":0}
128112025-08-01T16:11:19.878ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
128122025-08-01T16:11:19.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
128132025-08-01T16:11:19.880ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:391
128142025-08-01T16:11:19.880ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 121.382651ms iteration = 28 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
128152025-08-01T16:11:19.880ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 193.067704ms iteration = 28 status = null
128162025-08-01T16:11:19.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f150ee31-5067-4ced-99f7-a6234f3b4c50 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
128172025-08-01T16:11:19.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f150ee31-5067-4ced-99f7-a6234f3b4c50 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
128182025-08-01T16:11:19.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2214 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f150ee31-5067-4ced-99f7-a6234f3b4c50 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
128192025-08-01T16:11:19.889ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
128202025-08-01T16:11:19.889ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
128212025-08-01T16:11:19.890ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e475137-c887-43a8-b996-e0636fe8a1c3", "content-length": "372", "date": "Fri, 01 Aug 2025 16:11:19 GMT"} })
128222025-08-01T16:11:19.890ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128232025-08-01T16:11:19.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128242025-08-01T16:11:19.906ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 zone_address = fd00:1122:3344:101::2
128252025-08-01T16:11:19.906ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
128262025-08-01T16:11:19.906ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0b0a5fd-7c8b-479b-a4c8-0a0365a32522", "content-length": "26", "date": "Fri, 01 Aug 2025 16:11:19 GMT"} })
128272025-08-01T16:11:19.906ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
128282025-08-01T16:11:19.908ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
128292025-08-01T16:11:19.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 917 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = d4e57028-9f29-4390-b789-cf2fe6ad2427 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
128302025-08-01T16:11:19.929ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128312025-08-01T16:11:19.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128322025-08-01T16:11:19.931ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128332025-08-01T16:11:19.933ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
128342025-08-01T16:11:19.933ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128352025-08-01T16:11:19.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128362025-08-01T16:11:19.938ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128372025-08-01T16:11:19.940ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
128382025-08-01T16:11:19.940ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128392025-08-01T16:11:19.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128402025-08-01T16:11:19.953ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
128412025-08-01T16:11:19.953ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
128422025-08-01T16:11:19.953ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fd2c6b60-7a22-48e7-a9cd-40c019ad91d2", "date": "Fri, 01 Aug 2025 16:11:19 GMT"} })
128432025-08-01T16:11:19.953ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128442025-08-01T16:11:19.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128452025-08-01T16:11:19.955ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128462025-08-01T16:11:19.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128472025-08-01T16:11:19.958ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128482025-08-01T16:11:19.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128492025-08-01T16:11:19.961ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
128502025-08-01T16:11:19.961ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
128512025-08-01T16:11:19.961ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d020dfac-667a-488e-af08-f2fb9146b3f9", "date": "Fri, 01 Aug 2025 16:11:19 GMT"} })
128522025-08-01T16:11:19.963ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 204.987155ms iteration = 29 status = {}
128532025-08-01T16:11:19.984ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
128542025-08-01T16:11:19.984ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bb8d91c-32e4-40b8-bab8-97e6d10f8a55", "content-length": "691", "date": "Fri, 01 Aug 2025 16:11:19 GMT"} })
128552025-08-01T16:11:19.984ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
128562025-08-01T16:11:19.984ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
128572025-08-01T16:11:19.984ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
128582025-08-01T16:11:19.986ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 227.752996ms iteration = 29 status = {}
128592025-08-01T16:11:20.013ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128602025-08-01T16:11:20.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128612025-08-01T16:11:20.015ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 3f21d9d5-3adf-463a-a05d-bc2e2e5d64ca, rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(4c7da70d-ede0-4107-abc5-5650a053be38) } rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
128622025-08-01T16:11:20.015ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128632025-08-01T16:11:20.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128642025-08-01T16:11:20.024ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
128652025-08-01T16:11:20.024ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 4c7da70d-ede0-4107-abc5-5650a053be38
128662025-08-01T16:11:20.025ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
128672025-08-01T16:11:20.025ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
128682025-08-01T16:11:20.025ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
128692025-08-01T16:11:20.025ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
128702025-08-01T16:11:20.025ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
128712025-08-01T16:11:20.025ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
128722025-08-01T16:11:20.025ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
128732025-08-01T16:11:20.025ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
128742025-08-01T16:11:20.025ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
128752025-08-01T16:11:20.025ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128762025-08-01T16:11:20.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128772025-08-01T16:11:20.027ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
128782025-08-01T16:11:20.027ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
128792025-08-01T16:11:20.138ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3b5feaaf-5247-44b5-9407-f5a538301476", "date": "Fri, 01 Aug 2025 16:11:20 GMT"} })
128802025-08-01T16:11:20.138ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch = Switch0
128812025-08-01T16:11:20.138ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
128822025-08-01T16:11:20.144ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9db70b7-8540-49b8-9fa1-23580d7e8f3c", "content-length": "682", "date": "Fri, 01 Aug 2025 16:11:19 GMT"} })
128832025-08-01T16:11:20.144ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128842025-08-01T16:11:20.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128852025-08-01T16:11:20.149ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128862025-08-01T16:11:20.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128872025-08-01T16:11:20.152ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128882025-08-01T16:11:20.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128892025-08-01T16:11:20.155ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128902025-08-01T16:11:20.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128912025-08-01T16:11:20.162ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 403.379121ms iteration = 28 status = {}
128922025-08-01T16:11:20.803ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 5
128932025-08-01T16:11:20.803ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221
128942025-08-01T16:11:20.833ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
128952025-08-01T16:11:20.833ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:35981
128962025-08-01T16:11:20.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:35981 req_id = a8a52d45-175b-4fe0-bfcf-09e0efb407cd roles = RoleSet { roles: {} } uri = /metrics/producers
128972025-08-01T16:11:20.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:35981 req_id = a8a52d45-175b-4fe0-bfcf-09e0efb407cd resource = Database result = Ok(()) uri = /metrics/producers
128982025-08-01T16:11:20.875ZINFOnexus: assigned collector to new producer collector_id = 7bf2727d-8ae8-417c-81cf-59aa0ad1690b file = nexus/src/app/oximeter.rs:76 producer_id = 7248190d-c184-423c-8431-31fe40a79e2e
128992025-08-01T16:11:20.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 42470 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:35981 req_id = a8a52d45-175b-4fe0-bfcf-09e0efb407cd response_code = 201 uri = /metrics/producers
129002025-08-01T16:11:20.875ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "a8a52d45-175b-4fe0-bfcf-09e0efb407cd", "content-length": "41", "date": "Fri, 01 Aug 2025 16:11:19 GMT"} })
129012025-08-01T16:11:20.876ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
129022025-08-01T16:11:20.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = de5f6155-978e-4a4c-984b-7cd72cd9739d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129032025-08-01T16:11:20.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = de5f6155-978e-4a4c-984b-7cd72cd9739d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129042025-08-01T16:11:20.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2438 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = de5f6155-978e-4a4c-984b-7cd72cd9739d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129052025-08-01T16:11:21.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 641177bf-6349-4ac3-b488-731d900e4e8b roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129062025-08-01T16:11:21.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 641177bf-6349-4ac3-b488-731d900e4e8b resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129072025-08-01T16:11:21.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2416 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 641177bf-6349-4ac3-b488-731d900e4e8b response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129082025-08-01T16:11:22.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1e626eb9-1576-4cab-9320-9bcb737b02f9 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129092025-08-01T16:11:22.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1e626eb9-1576-4cab-9320-9bcb737b02f9 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129102025-08-01T16:11:22.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2484 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1e626eb9-1576-4cab-9320-9bcb737b02f9 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129112025-08-01T16:11:23.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 28419aab-1435-4a8c-99bc-ce24ec54143d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129122025-08-01T16:11:23.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 28419aab-1435-4a8c-99bc-ce24ec54143d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129132025-08-01T16:11:23.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2403 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 28419aab-1435-4a8c-99bc-ce24ec54143d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129142025-08-01T16:11:24.757ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 164 reason = Timeout
129152025-08-01T16:11:24.757ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
129162025-08-01T16:11:24.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
129172025-08-01T16:11:24.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129182025-08-01T16:11:24.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
129192025-08-01T16:11:24.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
129202025-08-01T16:11:24.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
129212025-08-01T16:11:24.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
129222025-08-01T16:11:24.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.096155ms iteration = 164 status = {"chicken_switches_updated":false}
129232025-08-01T16:11:24.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 01e68c5b-0cfc-4880-9189-3e14e15eb0e3 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129242025-08-01T16:11:24.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 01e68c5b-0cfc-4880-9189-3e14e15eb0e3 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129252025-08-01T16:11:24.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2963 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 01e68c5b-0cfc-4880-9189-3e14e15eb0e3 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129262025-08-01T16:11:25.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 65b84d3a-7861-4e95-8bd3-cfbbe07d5021 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129272025-08-01T16:11:25.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 65b84d3a-7861-4e95-8bd3-cfbbe07d5021 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129282025-08-01T16:11:25.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2541 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 65b84d3a-7861-4e95-8bd3-cfbbe07d5021 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129292025-08-01T16:11:27.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2784da5f-43e0-4530-a6a3-d2014a5ab5ef roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129302025-08-01T16:11:27.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2784da5f-43e0-4530-a6a3-d2014a5ab5ef resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129312025-08-01T16:11:27.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 5067 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2784da5f-43e0-4530-a6a3-d2014a5ab5ef response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129322025-08-01T16:11:28.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1c1e643b-2155-46bc-ab2c-9e2be26e3b9d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129332025-08-01T16:11:28.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1c1e643b-2155-46bc-ab2c-9e2be26e3b9d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129342025-08-01T16:11:28.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2307 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1c1e643b-2155-46bc-ab2c-9e2be26e3b9d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129352025-08-01T16:11:29.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a3ceab21-eea7-4199-b10f-9b246209bf05 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129362025-08-01T16:11:29.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a3ceab21-eea7-4199-b10f-9b246209bf05 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129372025-08-01T16:11:29.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2729 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a3ceab21-eea7-4199-b10f-9b246209bf05 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129382025-08-01T16:11:29.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
129392025-08-01T16:11:29.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
129402025-08-01T16:11:29.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 165 reason = Timeout
129412025-08-01T16:11:29.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
129422025-08-01T16:11:29.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
129432025-08-01T16:11:29.758ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
129442025-08-01T16:11:29.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
129452025-08-01T16:11:29.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129462025-08-01T16:11:29.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129472025-08-01T16:11:29.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
129482025-08-01T16:11:29.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
129492025-08-01T16:11:29.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129502025-08-01T16:11:29.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129512025-08-01T16:11:29.763ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.96651ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
129522025-08-01T16:11:29.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
129532025-08-01T16:11:29.765ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
129542025-08-01T16:11:29.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
129552025-08-01T16:11:29.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
129562025-08-01T16:11:29.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129572025-08-01T16:11:29.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129582025-08-01T16:11:29.767ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
129592025-08-01T16:11:29.767ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.951771ms iteration = 165 status = {"chicken_switches_updated":false}
129602025-08-01T16:11:29.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129612025-08-01T16:11:29.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129622025-08-01T16:11:29.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129632025-08-01T16:11:29.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
129642025-08-01T16:11:29.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129652025-08-01T16:11:29.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129662025-08-01T16:11:29.785ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
129672025-08-01T16:11:29.785ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.515164ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
129682025-08-01T16:11:29.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 566 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 54be87e6-411b-4a4f-a6b7-7089e5cf253b response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
129692025-08-01T16:11:30.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2b283925-d452-41dc-b326-4c1fbe6a435d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129702025-08-01T16:11:30.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2b283925-d452-41dc-b326-4c1fbe6a435d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129712025-08-01T16:11:30.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1928 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2b283925-d452-41dc-b326-4c1fbe6a435d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129722025-08-01T16:11:31.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 304e0853-64b9-4ac9-9acd-1fdd7618acf3 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129732025-08-01T16:11:31.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 304e0853-64b9-4ac9-9acd-1fdd7618acf3 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129742025-08-01T16:11:31.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2482 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 304e0853-64b9-4ac9-9acd-1fdd7618acf3 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129752025-08-01T16:11:32.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b20cfbc4-d249-4f3d-be71-891f74575c88 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129762025-08-01T16:11:32.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b20cfbc4-d249-4f3d-be71-891f74575c88 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129772025-08-01T16:11:32.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2538 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b20cfbc4-d249-4f3d-be71-891f74575c88 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129782025-08-01T16:11:33.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 80c187d9-3a93-40e7-b1d3-42197e0441f3 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129792025-08-01T16:11:33.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 80c187d9-3a93-40e7-b1d3-42197e0441f3 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129802025-08-01T16:11:33.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2400 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 80c187d9-3a93-40e7-b1d3-42197e0441f3 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129812025-08-01T16:11:34.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e8739ac9-a36f-4d7d-86c8-3a2b8a2497d1 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129822025-08-01T16:11:34.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e8739ac9-a36f-4d7d-86c8-3a2b8a2497d1 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129832025-08-01T16:11:34.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2373 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e8739ac9-a36f-4d7d-86c8-3a2b8a2497d1 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129842025-08-01T16:11:34.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 166 reason = Timeout
129852025-08-01T16:11:34.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
129862025-08-01T16:11:34.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
129872025-08-01T16:11:34.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129882025-08-01T16:11:34.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
129892025-08-01T16:11:34.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
129902025-08-01T16:11:34.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
129912025-08-01T16:11:34.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
129922025-08-01T16:11:34.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.447596ms iteration = 166 status = {"chicken_switches_updated":false}
129932025-08-01T16:11:35.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9d89597a-5dc1-4297-9d82-81e1a9574483 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129942025-08-01T16:11:35.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9d89597a-5dc1-4297-9d82-81e1a9574483 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129952025-08-01T16:11:35.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2939 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9d89597a-5dc1-4297-9d82-81e1a9574483 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129962025-08-01T16:11:36.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c5931872-9e27-46b0-a4e5-d9050cb646da roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129972025-08-01T16:11:36.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c5931872-9e27-46b0-a4e5-d9050cb646da resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129982025-08-01T16:11:36.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 5119 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c5931872-9e27-46b0-a4e5-d9050cb646da response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
129992025-08-01T16:11:37.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 46b5453e-5c13-4fd1-a897-e23e969735fd roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130002025-08-01T16:11:37.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 46b5453e-5c13-4fd1-a897-e23e969735fd resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130012025-08-01T16:11:37.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2858 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 46b5453e-5c13-4fd1-a897-e23e969735fd response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130022025-08-01T16:11:38.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e83dd5f9-d98f-45cc-b2bc-1ff14b5c6197 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130032025-08-01T16:11:38.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e83dd5f9-d98f-45cc-b2bc-1ff14b5c6197 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130042025-08-01T16:11:38.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1857 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e83dd5f9-d98f-45cc-b2bc-1ff14b5c6197 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130052025-08-01T16:11:39.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e229d4b7-1c66-49ab-bda8-2154b03adf05 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130062025-08-01T16:11:39.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e229d4b7-1c66-49ab-bda8-2154b03adf05 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130072025-08-01T16:11:39.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2658 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e229d4b7-1c66-49ab-bda8-2154b03adf05 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130082025-08-01T16:11:39.757ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
130092025-08-01T16:11:39.757ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 167 reason = Timeout
130102025-08-01T16:11:39.757ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
130112025-08-01T16:11:39.757ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
130122025-08-01T16:11:39.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
130132025-08-01T16:11:39.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
130142025-08-01T16:11:39.758ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
130152025-08-01T16:11:39.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130162025-08-01T16:11:39.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130172025-08-01T16:11:39.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130182025-08-01T16:11:39.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
130192025-08-01T16:11:39.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
130202025-08-01T16:11:39.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130212025-08-01T16:11:39.762ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.119316ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
130222025-08-01T16:11:39.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
130232025-08-01T16:11:39.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
130242025-08-01T16:11:39.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
130252025-08-01T16:11:39.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
130262025-08-01T16:11:39.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130272025-08-01T16:11:39.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130282025-08-01T16:11:39.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
130292025-08-01T16:11:39.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.970912ms iteration = 167 status = {"chicken_switches_updated":false}
130302025-08-01T16:11:39.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130312025-08-01T16:11:39.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130322025-08-01T16:11:39.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130332025-08-01T16:11:39.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
130342025-08-01T16:11:39.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130352025-08-01T16:11:39.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130362025-08-01T16:11:39.783ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
130372025-08-01T16:11:39.783ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.670128ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
130382025-08-01T16:11:39.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 812 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 090173b3-3761-408d-8783-804d28e9c3bb response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
130392025-08-01T16:11:40.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f4d22c15-be68-4e74-aa6d-a91eeb128314 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130402025-08-01T16:11:40.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f4d22c15-be68-4e74-aa6d-a91eeb128314 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130412025-08-01T16:11:40.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2038 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f4d22c15-be68-4e74-aa6d-a91eeb128314 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130422025-08-01T16:11:41.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 16ccd8b2-6dbb-4244-a806-34ca69036fd9 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130432025-08-01T16:11:41.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 16ccd8b2-6dbb-4244-a806-34ca69036fd9 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130442025-08-01T16:11:41.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2033 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 16ccd8b2-6dbb-4244-a806-34ca69036fd9 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130452025-08-01T16:11:42.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6acf3927-947c-4d64-b9eb-87fb8200fb2e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130462025-08-01T16:11:42.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6acf3927-947c-4d64-b9eb-87fb8200fb2e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130472025-08-01T16:11:42.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2699 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6acf3927-947c-4d64-b9eb-87fb8200fb2e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130482025-08-01T16:11:43.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bbf7d460-5c1d-4b45-85d1-b33fd3601438 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130492025-08-01T16:11:43.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bbf7d460-5c1d-4b45-85d1-b33fd3601438 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130502025-08-01T16:11:43.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2564 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bbf7d460-5c1d-4b45-85d1-b33fd3601438 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130512025-08-01T16:11:44.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d3047535-331c-479d-b976-c477296b7da2 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130522025-08-01T16:11:44.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d3047535-331c-479d-b976-c477296b7da2 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130532025-08-01T16:11:44.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2583 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d3047535-331c-479d-b976-c477296b7da2 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130542025-08-01T16:11:44.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 168 reason = Timeout
130552025-08-01T16:11:44.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
130562025-08-01T16:11:44.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
130572025-08-01T16:11:44.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130582025-08-01T16:11:44.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
130592025-08-01T16:11:44.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
130602025-08-01T16:11:44.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
130612025-08-01T16:11:44.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
130622025-08-01T16:11:44.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.647792ms iteration = 168 status = {"chicken_switches_updated":false}
130632025-08-01T16:11:45.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 145de2f2-0d27-4075-b384-4ee7e694bcd9 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130642025-08-01T16:11:45.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 145de2f2-0d27-4075-b384-4ee7e694bcd9 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130652025-08-01T16:11:45.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2297 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 145de2f2-0d27-4075-b384-4ee7e694bcd9 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130662025-08-01T16:11:46.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 96093dde-73bc-4b01-9aab-9412c5ca3da3 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130672025-08-01T16:11:46.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 96093dde-73bc-4b01-9aab-9412c5ca3da3 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130682025-08-01T16:11:46.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2563 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 96093dde-73bc-4b01-9aab-9412c5ca3da3 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130692025-08-01T16:11:47.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 47b6843e-1a25-445b-a228-5d836b734bfd roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130702025-08-01T16:11:47.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 47b6843e-1a25-445b-a228-5d836b734bfd resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130712025-08-01T16:11:47.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2767 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 47b6843e-1a25-445b-a228-5d836b734bfd response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130722025-08-01T16:11:48.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 533b9e1b-aeef-4db0-b5bc-befcf84afeda roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130732025-08-01T16:11:48.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 533b9e1b-aeef-4db0-b5bc-befcf84afeda resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130742025-08-01T16:11:48.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2214 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 533b9e1b-aeef-4db0-b5bc-befcf84afeda response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130752025-08-01T16:11:49.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2efdc783-bcdb-4c4b-926f-46f6e7477776 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130762025-08-01T16:11:49.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2efdc783-bcdb-4c4b-926f-46f6e7477776 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130772025-08-01T16:11:49.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2792 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2efdc783-bcdb-4c4b-926f-46f6e7477776 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
130782025-08-01T16:11:49.686ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
130792025-08-01T16:11:49.686ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
130802025-08-01T16:11:49.686ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
130812025-08-01T16:11:49.686ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
130822025-08-01T16:11:49.686ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-01 16:01:49.686801896 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
130832025-08-01T16:11:49.686ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
130842025-08-01T16:11:49.686ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
130852025-08-01T16:11:49.686ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
130862025-08-01T16:11:49.686ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
130872025-08-01T16:11:49.686ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
130882025-08-01T16:11:49.686ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
130892025-08-01T16:11:49.686ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
130902025-08-01T16:11:49.686ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
130912025-08-01T16:11:49.686ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
130922025-08-01T16:11:49.686ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
130932025-08-01T16:11:49.686ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
130942025-08-01T16:11:49.686ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
130952025-08-01T16:11:49.686ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
130962025-08-01T16:11:49.687ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
130972025-08-01T16:11:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
130982025-08-01T16:11:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
130992025-08-01T16:11:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
131002025-08-01T16:11:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
131012025-08-01T16:11:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
131022025-08-01T16:11:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
131032025-08-01T16:11:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
131042025-08-01T16:11:49.687ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cb706a84-a33b-442f-aac2-3a6eb5f3b330.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d688a68d-d771-4ac5-8e66-9efa94dbbea8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d688a68d-d771-4ac5-8e66-9efa94dbbea8.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 44405, tv_nsec: 704347397 } })
131052025-08-01T16:11:49.687ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50fe31de-3241-42df-a386-de37ce323a34.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("58598327-8751-423c-a5ac-c610829651e2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 44405, tv_nsec: 704367637 } })
131062025-08-01T16:11:49.687ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
131072025-08-01T16:11:49.687ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.065753ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
131082025-08-01T16:11:49.687ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
131092025-08-01T16:11:49.687ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.046352ms iteration = 15 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
131102025-08-01T16:11:49.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
131112025-08-01T16:11:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
131122025-08-01T16:11:49.689ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
131132025-08-01T16:11:49.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
131142025-08-01T16:11:49.689ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-01 16:01:49.686801896 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
131152025-08-01T16:11:49.689ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.614769ms iteration = 15 status = {"expiration":"2025-08-01T16:01:49.686801896Z","pruned":[]}
131162025-08-01T16:11:49.693ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44405, tv_nsec: 710299167 } })
131172025-08-01T16:11:49.693ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131182025-08-01T16:11:49.693ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
131192025-08-01T16:11:49.693ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.020023ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
131202025-08-01T16:11:49.695ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44405, tv_nsec: 712499624 } })
131212025-08-01T16:11:49.695ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131222025-08-01T16:11:49.696ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
131232025-08-01T16:11:49.696ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131242025-08-01T16:11:49.697ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
131252025-08-01T16:11:49.697ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
131262025-08-01T16:11:49.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
131272025-08-01T16:11:49.700ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
131282025-08-01T16:11:49.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
131292025-08-01T16:11:49.701ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
131302025-08-01T16:11:49.704ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131312025-08-01T16:11:49.704ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
131322025-08-01T16:11:49.704ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
131332025-08-01T16:11:49.704ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
131342025-08-01T16:11:49.704ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
131352025-08-01T16:11:49.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
131362025-08-01T16:11:49.705ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
131372025-08-01T16:11:49.705ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1
131382025-08-01T16:11:49.705ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.48\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1"}
131392025-08-01T16:11:49.706ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
131402025-08-01T16:11:49.709ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 19 reason = Timeout
131412025-08-01T16:11:49.709ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
131422025-08-01T16:11:49.709ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 17.51\u{b5}s iteration = 19 status = "Disabled"
131432025-08-01T16:11:49.709ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131442025-08-01T16:11:49.709ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 15 reason = Timeout
131452025-08-01T16:11:49.709ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
131462025-08-01T16:11:49.709ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 15 reason = Timeout
131472025-08-01T16:11:49.709ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
131482025-08-01T16:11:49.709ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
131492025-08-01T16:11:49.709ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
131502025-08-01T16:11:49.709ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
131512025-08-01T16:11:49.709ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
131522025-08-01T16:11:49.709ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
131532025-08-01T16:11:49.709ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
131542025-08-01T16:11:49.709ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
131552025-08-01T16:11:49.709ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
131562025-08-01T16:11:49.709ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
131572025-08-01T16:11:49.709ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
131582025-08-01T16:11:49.709ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
131592025-08-01T16:11:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
131602025-08-01T16:11:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
131612025-08-01T16:11:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
131622025-08-01T16:11:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
131632025-08-01T16:11:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
131642025-08-01T16:11:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
131652025-08-01T16:11:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
131662025-08-01T16:11:49.711ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
131672025-08-01T16:11:49.711ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
131682025-08-01T16:11:49.711ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
131692025-08-01T16:11:49.711ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
131702025-08-01T16:11:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
131712025-08-01T16:11:49.712ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
131722025-08-01T16:11:49.712ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
131732025-08-01T16:11:49.712ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 3.244779ms iteration = 15 status = {"by_rx":{},"error":null}
131742025-08-01T16:11:49.713ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
131752025-08-01T16:11:49.713ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
131762025-08-01T16:11:49.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
131772025-08-01T16:11:49.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
131782025-08-01T16:11:49.714ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.770715ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
131792025-08-01T16:11:49.714ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131802025-08-01T16:11:49.714ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
131812025-08-01T16:11:49.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
131822025-08-01T16:11:49.715ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
131832025-08-01T16:11:49.715ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
131842025-08-01T16:11:49.715ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 5.876908ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
131852025-08-01T16:11:49.715ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131862025-08-01T16:11:49.716ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131872025-08-01T16:11:49.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
131882025-08-01T16:11:49.717ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
131892025-08-01T16:11:49.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
131902025-08-01T16:11:49.718ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
131912025-08-01T16:11:49.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
131922025-08-01T16:11:49.719ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
131932025-08-01T16:11:49.719ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
131942025-08-01T16:11:49.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
131952025-08-01T16:11:49.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
131962025-08-01T16:11:49.720ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
131972025-08-01T16:11:49.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
131982025-08-01T16:11:49.720ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 11.2298ms iteration = 15 status = {"dispatched":[],"errors":[],"glob_version":"173.0.0","globs_reprocessed":{},"no_receivers":[]}
131992025-08-01T16:11:49.722ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
132002025-08-01T16:11:49.722ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6482e44c-c860-4033-b945-5707d343a59d dns_zone_name = oxide.test found_so_far = 0 version = 2
132012025-08-01T16:11:49.722ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
132022025-08-01T16:11:49.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
132032025-08-01T16:11:49.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132042025-08-01T16:11:49.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
132052025-08-01T16:11:49.732ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
132062025-08-01T16:11:49.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
132072025-08-01T16:11:49.736ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6482e44c-c860-4033-b945-5707d343a59d dns_zone_name = oxide.test found_so_far = 4 version = 2
132082025-08-01T16:11:49.736ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
132092025-08-01T16:11:49.736ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-01 15:58:34.713515 UTC dns_group = external generation = 2
132102025-08-01T16:11:49.736ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 49.294514ms iteration = 15 status = {"generation":2}
132112025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 29 reason = Timeout
132122025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
132132025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 22.911\u{b5}s iteration = 29 status = {"disabled":true,"errors":[],"sps":[]}
132142025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
132152025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
132162025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
132172025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
132182025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132192025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
132202025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 29 reason = Timeout
132212025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
132222025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
132232025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
132242025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
132252025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
132262025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
132272025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
132282025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132292025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 169 reason = Timeout
132302025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
132312025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
132322025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
132332025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
132342025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
132352025-08-01T16:11:49.758ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
132362025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
132372025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
132382025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 48.80805ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
132392025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
132402025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
132412025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
132422025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
132432025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
132442025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
132452025-08-01T16:11:49.758ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
132462025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132472025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
132482025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
132492025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 29 reason = Timeout
132502025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 02fcb774-aa43-4052-9996-b85e2d1358b5 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
132512025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
132522025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
132532025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
132542025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132552025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
132562025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
132572025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
132582025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132592025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132602025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
132612025-08-01T16:11:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
132622025-08-01T16:11:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
132632025-08-01T16:11:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
132642025-08-01T16:11:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
132652025-08-01T16:11:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
132662025-08-01T16:11:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
132672025-08-01T16:11:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
132682025-08-01T16:11:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
132692025-08-01T16:11:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
132702025-08-01T16:11:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132712025-08-01T16:11:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
132722025-08-01T16:11:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132732025-08-01T16:11:49.762ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132742025-08-01T16:11:49.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132752025-08-01T16:11:49.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132762025-08-01T16:11:49.763ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 5.234019ms iteration = 29 status = {"errors":[],"requests_created_ok":[]}
132772025-08-01T16:11:49.764ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132782025-08-01T16:11:49.765ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.713044ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
132792025-08-01T16:11:49.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
132802025-08-01T16:11:49.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
132812025-08-01T16:11:49.765ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132822025-08-01T16:11:49.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132832025-08-01T16:11:49.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
132842025-08-01T16:11:49.765ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132852025-08-01T16:11:49.766ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132862025-08-01T16:11:49.766ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132872025-08-01T16:11:49.766ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132882025-08-01T16:11:49.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
132892025-08-01T16:11:49.767ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
132902025-08-01T16:11:49.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
132912025-08-01T16:11:49.768ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132922025-08-01T16:11:49.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132932025-08-01T16:11:49.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132942025-08-01T16:11:49.770ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
132952025-08-01T16:11:49.770ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 11.694424ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
132962025-08-01T16:11:49.770ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
132972025-08-01T16:11:49.770ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
132982025-08-01T16:11:49.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
132992025-08-01T16:11:49.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
133002025-08-01T16:11:49.770ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
133012025-08-01T16:11:49.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
133022025-08-01T16:11:49.771ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
133032025-08-01T16:11:49.772ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44405, tv_nsec: 789015744 } })
133042025-08-01T16:11:49.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
133052025-08-01T16:11:49.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
133062025-08-01T16:11:49.772ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
133072025-08-01T16:11:49.772ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
133082025-08-01T16:11:49.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
133092025-08-01T16:11:49.772ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
133102025-08-01T16:11:49.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
133112025-08-01T16:11:49.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
133122025-08-01T16:11:49.773ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
133132025-08-01T16:11:49.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
133142025-08-01T16:11:49.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
133152025-08-01T16:11:49.773ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
133162025-08-01T16:11:49.773ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
133172025-08-01T16:11:49.773ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
133182025-08-01T16:11:49.773ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
133192025-08-01T16:11:49.773ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
133202025-08-01T16:11:49.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
133212025-08-01T16:11:49.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133222025-08-01T16:11:49.773ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
133232025-08-01T16:11:49.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
133242025-08-01T16:11:49.774ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 15.758788ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
133252025-08-01T16:11:49.774ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
133262025-08-01T16:11:49.774ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 16.196961ms iteration = 169 status = {"chicken_switches_updated":false}
133272025-08-01T16:11:49.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
133282025-08-01T16:11:49.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133292025-08-01T16:11:49.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
133302025-08-01T16:11:49.775ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133312025-08-01T16:11:49.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133322025-08-01T16:11:49.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133332025-08-01T16:11:49.775ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-01T15:57:44.766264Z, time_modified: 2025-08-01T15:57:44.766264Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: eec17da7-eb17-4917-8728-908698b69bbe, db_silo: Silo { identity: SiloIdentity { id: eec17da7-eb17-4917-8728-908698b69bbe, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-01T15:58:34.653875Z, time_modified: 2025-08-01T15:58:34.653875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: eec17da7-eb17-4917-8728-908698b69bbe, db_silo: Silo { identity: SiloIdentity { id: eec17da7-eb17-4917-8728-908698b69bbe, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-01T15:58:34.653875Z, time_modified: 2025-08-01T15:58:34.653875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575" }] }) }
133342025-08-01T16:11:49.775ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 88.967397ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"eec17da7-eb17-4917-8728-908698b69bbe","tls_certs":["b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575"]}},"default_endpoint":{"silo_id":"eec17da7-eb17-4917-8728-908698b69bbe","tls_certs":["b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
133352025-08-01T16:11:49.776ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 02fcb774-aa43-4052-9996-b85e2d1358b5 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
133362025-08-01T16:11:49.776ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
133372025-08-01T16:11:49.776ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-01 15:58:34.032744 UTC dns_group = internal generation = 1
133382025-08-01T16:11:49.776ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 89.344809ms iteration = 15 status = {"generation":1}
133392025-08-01T16:11:49.776ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133402025-08-01T16:11:49.779ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
133412025-08-01T16:11:49.779ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
133422025-08-01T16:11:49.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133432025-08-01T16:11:49.782ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133442025-08-01T16:11:49.783ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133452025-08-01T16:11:49.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133462025-08-01T16:11:49.785ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133472025-08-01T16:11:49.785ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
133482025-08-01T16:11:49.785ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
133492025-08-01T16:11:49.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
133502025-08-01T16:11:49.788ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133512025-08-01T16:11:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133522025-08-01T16:11:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
133532025-08-01T16:11:49.789ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133542025-08-01T16:11:49.789ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
133552025-08-01T16:11:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133562025-08-01T16:11:49.804ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
133572025-08-01T16:11:49.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 48.299674ms iteration = 29 status = {"errors":[],"finish_invoked_ok":[]}
133582025-08-01T16:11:49.812ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
133592025-08-01T16:11:49.812ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 54.622437ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
133602025-08-01T16:11:49.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
133612025-08-01T16:11:49.814ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
133622025-08-01T16:11:49.814ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.022479ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
133632025-08-01T16:11:49.836ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
133642025-08-01T16:11:49.836ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
133652025-08-01T16:11:49.837ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "11186fd3-c36a-48b0-b754-7faf21c2bf62", "content-length": "26", "date": "Fri, 01 Aug 2025 16:11:49 GMT"} })
133662025-08-01T16:11:49.837ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
133672025-08-01T16:11:49.838ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
133682025-08-01T16:11:49.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
133692025-08-01T16:11:49.839ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
133702025-08-01T16:11:49.840ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
133712025-08-01T16:11:49.840ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
133722025-08-01T16:11:49.841ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133732025-08-01T16:11:49.841ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7b37767-9a88-468f-a109-7874ff7f538f", "content-length": "26", "date": "Fri, 01 Aug 2025 16:11:49 GMT"} })
133742025-08-01T16:11:49.841ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
133752025-08-01T16:11:49.842ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133762025-08-01T16:11:49.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133772025-08-01T16:11:49.843ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
133782025-08-01T16:11:49.846ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
133792025-08-01T16:11:49.846ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 87.73542ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
133802025-08-01T16:11:49.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133812025-08-01T16:11:49.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133822025-08-01T16:11:49.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
133832025-08-01T16:11:49.846ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
133842025-08-01T16:11:49.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
133852025-08-01T16:11:49.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133862025-08-01T16:11:49.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
133872025-08-01T16:11:49.853ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133882025-08-01T16:11:49.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133892025-08-01T16:11:49.855ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
133902025-08-01T16:11:49.855ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
133912025-08-01T16:11:49.855ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 97.123685ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
133922025-08-01T16:11:49.859ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:391
133932025-08-01T16:11:49.859ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 100.855618ms iteration = 29 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
133942025-08-01T16:11:49.859ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 101.343313ms iteration = 29 status = 0
133952025-08-01T16:11:49.867ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 108.794479ms iteration = 32 status = {"physical_disks_added":0}
133962025-08-01T16:11:49.882ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
133972025-08-01T16:11:49.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
133982025-08-01T16:11:49.886ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 128.394093ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
133992025-08-01T16:11:49.905ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 zone_address = fd00:1122:3344:101::2
134002025-08-01T16:11:49.905ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
134012025-08-01T16:11:49.905ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d9c8afb-e87b-4892-82f9-e044f60e083b", "content-length": "26", "date": "Fri, 01 Aug 2025 16:11:49 GMT"} })
134022025-08-01T16:11:49.905ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
134032025-08-01T16:11:49.907ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
134042025-08-01T16:11:49.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 983 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = cd0e5bb5-7b85-461f-ae3a-9fbccad17aaf response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
134052025-08-01T16:11:49.931ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
134062025-08-01T16:11:49.931ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 221.271399ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
134072025-08-01T16:11:49.933ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
134082025-08-01T16:11:49.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
134092025-08-01T16:11:49.976ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
134102025-08-01T16:11:49.977ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "18e1ba82-acbf-4224-b4cf-93fcbf7fa43b", "date": "Fri, 01 Aug 2025 16:11:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
134112025-08-01T16:11:49.977ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
134122025-08-01T16:11:49.977ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
134132025-08-01T16:11:49.978ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "457151d1-5352-4d7a-9da5-3b7bf8d8d2e6", "date": "Fri, 01 Aug 2025 16:11:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
134142025-08-01T16:11:49.978ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
134152025-08-01T16:11:49.980ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
134162025-08-01T16:11:49.980ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 293.927892ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
134172025-08-01T16:11:49.993ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 306.698299ms iteration = 29 status = {}
134182025-08-01T16:11:50.011ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
134192025-08-01T16:11:50.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
134202025-08-01T16:11:50.013ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134212025-08-01T16:11:50.016ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
134222025-08-01T16:11:50.016ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
134232025-08-01T16:11:50.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
134242025-08-01T16:11:50.017ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134252025-08-01T16:11:50.019ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
134262025-08-01T16:11:50.019ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
134272025-08-01T16:11:50.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
134282025-08-01T16:11:50.124ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
134292025-08-01T16:11:50.124ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5837e931-26b4-4d6d-bedc-313de81afc23", "date": "Fri, 01 Aug 2025 16:11:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
134302025-08-01T16:11:50.124ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
134312025-08-01T16:11:50.125ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "3efa24d1-2fdc-45bc-bbf4-0fdb9e197b31", "date": "Fri, 01 Aug 2025 16:11:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
134322025-08-01T16:11:50.125ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
134332025-08-01T16:11:50.127ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b8c83ea4-87aa-4694-bd77-66e01c163252", "date": "Fri, 01 Aug 2025 16:11:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
134342025-08-01T16:11:50.127ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
134352025-08-01T16:11:50.128ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
134362025-08-01T16:11:50.128ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 441.966421ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
134372025-08-01T16:11:50.133ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
134382025-08-01T16:11:50.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
134392025-08-01T16:11:50.135ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 448.255382ms iteration = 29 status = null
134402025-08-01T16:11:50.158ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
134412025-08-01T16:11:50.158ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "88db156c-b76b-4f2b-ab08-b7e078cc6c78", "content-length": "691", "date": "Fri, 01 Aug 2025 16:11:49 GMT"} })
134422025-08-01T16:11:50.158ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
134432025-08-01T16:11:50.158ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
134442025-08-01T16:11:50.158ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
134452025-08-01T16:11:50.160ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 401.813083ms iteration = 30 status = {}
134462025-08-01T16:11:50.211ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
134472025-08-01T16:11:50.211ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
134482025-08-01T16:11:50.217ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "129b239a-8b71-4363-8249-5a01f69a9f5b", "content-length": "372", "date": "Fri, 01 Aug 2025 16:11:49 GMT"} })
134492025-08-01T16:11:50.217ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
134502025-08-01T16:11:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134512025-08-01T16:11:50.266ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
134522025-08-01T16:11:50.266ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
134532025-08-01T16:11:50.268ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3fabc72e-a55f-4edf-b818-5e39cf66cda0", "date": "Fri, 01 Aug 2025 16:11:49 GMT"} })
134542025-08-01T16:11:50.268ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
134552025-08-01T16:11:50.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134562025-08-01T16:11:50.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134572025-08-01T16:11:50.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134582025-08-01T16:11:50.271ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 3f21d9d5-3adf-463a-a05d-bc2e2e5d64ca, rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(4c7da70d-ede0-4107-abc5-5650a053be38) } rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
134592025-08-01T16:11:50.271ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134602025-08-01T16:11:50.271ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
134612025-08-01T16:11:50.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134622025-08-01T16:11:50.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134632025-08-01T16:11:50.275ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
134642025-08-01T16:11:50.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134652025-08-01T16:11:50.277ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
134662025-08-01T16:11:50.277ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
134672025-08-01T16:11:50.278ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "65642151-561e-4e8e-9f55-9aef9ca94711", "date": "Fri, 01 Aug 2025 16:11:49 GMT"} })
134682025-08-01T16:11:50.280ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 521.429661ms iteration = 30 status = {}
134692025-08-01T16:11:50.285ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
134702025-08-01T16:11:50.285ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 4c7da70d-ede0-4107-abc5-5650a053be38
134712025-08-01T16:11:50.285ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
134722025-08-01T16:11:50.285ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
134732025-08-01T16:11:50.285ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
134742025-08-01T16:11:50.285ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
134752025-08-01T16:11:50.286ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
134762025-08-01T16:11:50.286ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
134772025-08-01T16:11:50.286ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
134782025-08-01T16:11:50.286ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
134792025-08-01T16:11:50.286ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
134802025-08-01T16:11:50.286ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134812025-08-01T16:11:50.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134822025-08-01T16:11:50.288ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
134832025-08-01T16:11:50.288ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
134842025-08-01T16:11:50.388ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d2e0f5c2-b837-4bf0-a29f-519855fabe75", "date": "Fri, 01 Aug 2025 16:11:50 GMT"} })
134852025-08-01T16:11:50.388ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch = Switch0
134862025-08-01T16:11:50.388ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
134872025-08-01T16:11:50.388ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8da68a5c-1041-4224-8bc8-944d5d446a1f", "content-length": "682", "date": "Fri, 01 Aug 2025 16:11:49 GMT"} })
134882025-08-01T16:11:50.388ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134892025-08-01T16:11:50.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134902025-08-01T16:11:50.392ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134912025-08-01T16:11:50.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134922025-08-01T16:11:50.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a8326d61-ae84-4741-b2c8-b61f0402e663 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
134932025-08-01T16:11:50.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a8326d61-ae84-4741-b2c8-b61f0402e663 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
134942025-08-01T16:11:50.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2338 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = a8326d61-ae84-4741-b2c8-b61f0402e663 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
134952025-08-01T16:11:50.395ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134962025-08-01T16:11:50.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134972025-08-01T16:11:50.398ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134982025-08-01T16:11:50.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134992025-08-01T16:11:50.405ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 647.434521ms iteration = 29 status = {}
135002025-08-01T16:11:51.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b5714b96-2342-48cf-b5d9-995d2c36a9c1 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135012025-08-01T16:11:51.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b5714b96-2342-48cf-b5d9-995d2c36a9c1 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135022025-08-01T16:11:51.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2299 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b5714b96-2342-48cf-b5d9-995d2c36a9c1 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135032025-08-01T16:11:52.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2cd5f435-e715-4acc-be41-cca7771d17b5 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135042025-08-01T16:11:52.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2cd5f435-e715-4acc-be41-cca7771d17b5 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135052025-08-01T16:11:52.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2073 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2cd5f435-e715-4acc-be41-cca7771d17b5 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135062025-08-01T16:11:53.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 13d83199-7168-4326-a9fb-f6a1919f2997 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135072025-08-01T16:11:53.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 13d83199-7168-4326-a9fb-f6a1919f2997 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135082025-08-01T16:11:53.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2404 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 13d83199-7168-4326-a9fb-f6a1919f2997 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135092025-08-01T16:11:54.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5da1f5c1-4608-4261-869a-b169ef0ef718 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135102025-08-01T16:11:54.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5da1f5c1-4608-4261-869a-b169ef0ef718 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135112025-08-01T16:11:54.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2766 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5da1f5c1-4608-4261-869a-b169ef0ef718 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135122025-08-01T16:11:54.757ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 170 reason = Timeout
135132025-08-01T16:11:54.757ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
135142025-08-01T16:11:54.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
135152025-08-01T16:11:54.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135162025-08-01T16:11:54.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
135172025-08-01T16:11:54.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
135182025-08-01T16:11:54.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
135192025-08-01T16:11:54.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
135202025-08-01T16:11:54.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.711424ms iteration = 170 status = {"chicken_switches_updated":false}
135212025-08-01T16:11:55.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8156fae8-5890-41f5-9ef0-a4356deaf1e9 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135222025-08-01T16:11:55.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8156fae8-5890-41f5-9ef0-a4356deaf1e9 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135232025-08-01T16:11:55.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2059 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8156fae8-5890-41f5-9ef0-a4356deaf1e9 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135242025-08-01T16:11:56.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3a42efc2-afe7-4bcf-88b6-a2940ddec90e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135252025-08-01T16:11:56.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3a42efc2-afe7-4bcf-88b6-a2940ddec90e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135262025-08-01T16:11:56.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2487 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3a42efc2-afe7-4bcf-88b6-a2940ddec90e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135272025-08-01T16:11:57.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e13bb163-83cc-4b44-bc14-4683d336ddf4 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135282025-08-01T16:11:57.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e13bb163-83cc-4b44-bc14-4683d336ddf4 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135292025-08-01T16:11:57.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2672 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e13bb163-83cc-4b44-bc14-4683d336ddf4 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135302025-08-01T16:11:58.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 25216a31-7c9f-4410-b38e-548ccbf41303 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135312025-08-01T16:11:58.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 25216a31-7c9f-4410-b38e-548ccbf41303 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135322025-08-01T16:11:58.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2511 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 25216a31-7c9f-4410-b38e-548ccbf41303 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135332025-08-01T16:11:59.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bbf83aa9-feac-44d5-8b62-e0b1eab43985 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135342025-08-01T16:11:59.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bbf83aa9-feac-44d5-8b62-e0b1eab43985 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135352025-08-01T16:11:59.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2437 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bbf83aa9-feac-44d5-8b62-e0b1eab43985 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135362025-08-01T16:11:59.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
135372025-08-01T16:11:59.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 171 reason = Timeout
135382025-08-01T16:11:59.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
135392025-08-01T16:11:59.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
135402025-08-01T16:11:59.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
135412025-08-01T16:11:59.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
135422025-08-01T16:11:59.758ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
135432025-08-01T16:11:59.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135442025-08-01T16:11:59.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135452025-08-01T16:11:59.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
135462025-08-01T16:11:59.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
135472025-08-01T16:11:59.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135482025-08-01T16:11:59.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135492025-08-01T16:11:59.762ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.411304ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
135502025-08-01T16:11:59.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
135512025-08-01T16:11:59.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
135522025-08-01T16:11:59.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
135532025-08-01T16:11:59.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
135542025-08-01T16:11:59.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135552025-08-01T16:11:59.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135562025-08-01T16:11:59.767ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
135572025-08-01T16:11:59.767ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.687453ms iteration = 171 status = {"chicken_switches_updated":false}
135582025-08-01T16:11:59.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135592025-08-01T16:11:59.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135602025-08-01T16:11:59.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135612025-08-01T16:11:59.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
135622025-08-01T16:11:59.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135632025-08-01T16:11:59.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135642025-08-01T16:11:59.785ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
135652025-08-01T16:11:59.785ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.274896ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
135662025-08-01T16:11:59.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 632 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 90b228c0-1118-4b61-99fb-dc60e0ddadf5 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
135672025-08-01T16:12:00.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d17bf1d9-df04-46da-8669-77e7fdff3c39 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135682025-08-01T16:12:00.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d17bf1d9-df04-46da-8669-77e7fdff3c39 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135692025-08-01T16:12:00.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2621 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d17bf1d9-df04-46da-8669-77e7fdff3c39 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135702025-08-01T16:12:01.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c4834e0f-2f13-44c3-9646-e09f4b30fb67 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135712025-08-01T16:12:01.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c4834e0f-2f13-44c3-9646-e09f4b30fb67 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135722025-08-01T16:12:01.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2165 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c4834e0f-2f13-44c3-9646-e09f4b30fb67 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135732025-08-01T16:12:02.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ea653073-ba1d-4f3f-b723-bdbd18a3e175 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135742025-08-01T16:12:02.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ea653073-ba1d-4f3f-b723-bdbd18a3e175 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135752025-08-01T16:12:02.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2078 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ea653073-ba1d-4f3f-b723-bdbd18a3e175 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135762025-08-01T16:12:03.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 18db575a-0789-417c-9703-4cf842b8c0cb roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135772025-08-01T16:12:03.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 18db575a-0789-417c-9703-4cf842b8c0cb resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135782025-08-01T16:12:03.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2590 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 18db575a-0789-417c-9703-4cf842b8c0cb response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135792025-08-01T16:12:04.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 76bb1300-bb1e-4248-94a6-8467462bc538 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135802025-08-01T16:12:04.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 76bb1300-bb1e-4248-94a6-8467462bc538 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135812025-08-01T16:12:04.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2433 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 76bb1300-bb1e-4248-94a6-8467462bc538 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135822025-08-01T16:12:04.757ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 172 reason = Timeout
135832025-08-01T16:12:04.757ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
135842025-08-01T16:12:04.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
135852025-08-01T16:12:04.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135862025-08-01T16:12:04.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
135872025-08-01T16:12:04.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
135882025-08-01T16:12:04.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
135892025-08-01T16:12:04.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
135902025-08-01T16:12:04.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.528918ms iteration = 172 status = {"chicken_switches_updated":false}
135912025-08-01T16:12:05.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b9d37de5-45c2-42d9-8fe5-702fe8f6980a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135922025-08-01T16:12:05.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b9d37de5-45c2-42d9-8fe5-702fe8f6980a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135932025-08-01T16:12:05.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2166 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b9d37de5-45c2-42d9-8fe5-702fe8f6980a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135942025-08-01T16:12:06.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d64c78c7-95c2-4388-8222-9b9f9d66181c roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135952025-08-01T16:12:06.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d64c78c7-95c2-4388-8222-9b9f9d66181c resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135962025-08-01T16:12:06.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2407 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d64c78c7-95c2-4388-8222-9b9f9d66181c response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135972025-08-01T16:12:07.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 74c2ee07-ced4-4415-8083-80e54d25a519 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135982025-08-01T16:12:07.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 74c2ee07-ced4-4415-8083-80e54d25a519 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
135992025-08-01T16:12:07.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2686 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 74c2ee07-ced4-4415-8083-80e54d25a519 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136002025-08-01T16:12:08.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3cab943a-3a9a-4976-9c6d-89bd16f35b45 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136012025-08-01T16:12:08.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3cab943a-3a9a-4976-9c6d-89bd16f35b45 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136022025-08-01T16:12:08.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2713 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3cab943a-3a9a-4976-9c6d-89bd16f35b45 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136032025-08-01T16:12:09.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 17458b48-8592-46e2-a246-32e1a9c67d3a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136042025-08-01T16:12:09.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 17458b48-8592-46e2-a246-32e1a9c67d3a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136052025-08-01T16:12:09.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2622 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 17458b48-8592-46e2-a246-32e1a9c67d3a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136062025-08-01T16:12:09.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
136072025-08-01T16:12:09.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 173 reason = Timeout
136082025-08-01T16:12:09.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
136092025-08-01T16:12:09.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
136102025-08-01T16:12:09.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
136112025-08-01T16:12:09.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
136122025-08-01T16:12:09.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
136132025-08-01T16:12:09.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
136142025-08-01T16:12:09.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136152025-08-01T16:12:09.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136162025-08-01T16:12:09.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
136172025-08-01T16:12:09.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
136182025-08-01T16:12:09.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136192025-08-01T16:12:09.762ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.458985ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
136202025-08-01T16:12:09.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
136212025-08-01T16:12:09.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
136222025-08-01T16:12:09.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
136232025-08-01T16:12:09.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
136242025-08-01T16:12:09.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
136252025-08-01T16:12:09.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136262025-08-01T16:12:09.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
136272025-08-01T16:12:09.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.404445ms iteration = 173 status = {"chicken_switches_updated":false}
136282025-08-01T16:12:09.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
136292025-08-01T16:12:09.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136302025-08-01T16:12:09.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136312025-08-01T16:12:09.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
136322025-08-01T16:12:09.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
136332025-08-01T16:12:09.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136342025-08-01T16:12:09.784ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
136352025-08-01T16:12:09.784ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.887004ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
136362025-08-01T16:12:09.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 686 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = d97a76f2-1ed3-470c-8d28-d44415356c79 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
136372025-08-01T16:12:10.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1c0404c9-5848-42c3-8321-cfa78d002bf8 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136382025-08-01T16:12:10.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1c0404c9-5848-42c3-8321-cfa78d002bf8 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136392025-08-01T16:12:10.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2592 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1c0404c9-5848-42c3-8321-cfa78d002bf8 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136402025-08-01T16:12:11.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2dabeef7-03a3-4fa8-b35c-46bf6a5f5de6 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136412025-08-01T16:12:11.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2dabeef7-03a3-4fa8-b35c-46bf6a5f5de6 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136422025-08-01T16:12:11.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2201 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2dabeef7-03a3-4fa8-b35c-46bf6a5f5de6 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136432025-08-01T16:12:12.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 334f9e76-9317-4d56-92ee-5a6c9c0f52e1 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136442025-08-01T16:12:12.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 334f9e76-9317-4d56-92ee-5a6c9c0f52e1 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136452025-08-01T16:12:12.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2188 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 334f9e76-9317-4d56-92ee-5a6c9c0f52e1 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136462025-08-01T16:12:13.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b47fb6eb-f516-474e-862a-2c81d870a515 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136472025-08-01T16:12:13.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b47fb6eb-f516-474e-862a-2c81d870a515 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136482025-08-01T16:12:13.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2337 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b47fb6eb-f516-474e-862a-2c81d870a515 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136492025-08-01T16:12:14.757ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 174 reason = Timeout
136502025-08-01T16:12:14.757ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
136512025-08-01T16:12:14.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
136522025-08-01T16:12:14.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136532025-08-01T16:12:14.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
136542025-08-01T16:12:14.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
136552025-08-01T16:12:14.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
136562025-08-01T16:12:14.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
136572025-08-01T16:12:14.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.25206ms iteration = 174 status = {"chicken_switches_updated":false}
136582025-08-01T16:12:14.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3c763cba-eaf9-498d-88e5-9711dcadfec1 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136592025-08-01T16:12:14.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3c763cba-eaf9-498d-88e5-9711dcadfec1 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136602025-08-01T16:12:14.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2119 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3c763cba-eaf9-498d-88e5-9711dcadfec1 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136612025-08-01T16:12:15.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = abc94077-3fd0-4cb3-96fa-99281c1e87f5 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136622025-08-01T16:12:15.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = abc94077-3fd0-4cb3-96fa-99281c1e87f5 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136632025-08-01T16:12:15.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2403 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = abc94077-3fd0-4cb3-96fa-99281c1e87f5 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136642025-08-01T16:12:16.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 82c07765-1179-424c-b66d-c09cdc20d5db roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136652025-08-01T16:12:16.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 82c07765-1179-424c-b66d-c09cdc20d5db resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136662025-08-01T16:12:16.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2599 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 82c07765-1179-424c-b66d-c09cdc20d5db response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136672025-08-01T16:12:17.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f0d78496-1530-4cf6-8322-27cdbd2e7900 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136682025-08-01T16:12:17.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f0d78496-1530-4cf6-8322-27cdbd2e7900 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136692025-08-01T16:12:17.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2784 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f0d78496-1530-4cf6-8322-27cdbd2e7900 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136702025-08-01T16:12:18.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 29e43cc7-a90b-4eb1-a34f-cf979d74c571 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136712025-08-01T16:12:18.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 29e43cc7-a90b-4eb1-a34f-cf979d74c571 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136722025-08-01T16:12:18.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2776 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 29e43cc7-a90b-4eb1-a34f-cf979d74c571 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
136732025-08-01T16:12:19.687ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
136742025-08-01T16:12:19.687ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
136752025-08-01T16:12:19.687ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
136762025-08-01T16:12:19.687ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
136772025-08-01T16:12:19.687ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
136782025-08-01T16:12:19.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
136792025-08-01T16:12:19.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
136802025-08-01T16:12:19.690ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44435, tv_nsec: 707917378 } })
136812025-08-01T16:12:19.690ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.371173ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
136822025-08-01T16:12:19.691ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
136832025-08-01T16:12:19.691ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44435, tv_nsec: 708448014 } })
136842025-08-01T16:12:19.691ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
136852025-08-01T16:12:19.728ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
136862025-08-01T16:12:19.728ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
136872025-08-01T16:12:19.729ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2239bc08-808b-43cf-8ac7-9f8a27480499", "content-length": "26", "date": "Fri, 01 Aug 2025 16:12:19 GMT"} })
136882025-08-01T16:12:19.729ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
136892025-08-01T16:12:19.729ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
136902025-08-01T16:12:19.734ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
136912025-08-01T16:12:19.734ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
136922025-08-01T16:12:19.734ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0031a622-5d02-4c35-a4f1-e70b7f3d0c12", "content-length": "26", "date": "Fri, 01 Aug 2025 16:12:19 GMT"} })
136932025-08-01T16:12:19.734ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
136942025-08-01T16:12:19.736ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
136952025-08-01T16:12:19.757ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 30 reason = Timeout
136962025-08-01T16:12:19.757ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 14.66\u{b5}s iteration = 30 status = {"disabled":true,"errors":[],"sps":[]}
136972025-08-01T16:12:19.757ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
136982025-08-01T16:12:19.757ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
136992025-08-01T16:12:19.757ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
137002025-08-01T16:12:19.757ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
137012025-08-01T16:12:19.757ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
137022025-08-01T16:12:19.757ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
137032025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
137042025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
137052025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
137062025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
137072025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
137082025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
137092025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
137102025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
137112025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
137122025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 175 reason = Timeout
137132025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
137142025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
137152025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
137162025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
137172025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
137182025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
137192025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
137202025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
137212025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
137222025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
137232025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 31 reason = Timeout
137242025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
137252025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
137262025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
137272025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 30 reason = Timeout
137282025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
137292025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
137302025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
137312025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
137322025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
137332025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
137342025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
137352025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
137362025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
137372025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
137382025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
137392025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
137402025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
137412025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
137422025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
137432025-08-01T16:12:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
137442025-08-01T16:12:19.759ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 30 reason = Timeout
137452025-08-01T16:12:19.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
137462025-08-01T16:12:19.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137472025-08-01T16:12:19.759ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
137482025-08-01T16:12:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137492025-08-01T16:12:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
137502025-08-01T16:12:19.759ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137512025-08-01T16:12:19.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
137522025-08-01T16:12:19.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
137532025-08-01T16:12:19.761ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137542025-08-01T16:12:19.762ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.136705ms iteration = 30 status = {"errors":[],"finish_invoked_ok":[]}
137552025-08-01T16:12:19.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137562025-08-01T16:12:19.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
137572025-08-01T16:12:19.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
137582025-08-01T16:12:19.762ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
137592025-08-01T16:12:19.763ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137602025-08-01T16:12:19.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
137612025-08-01T16:12:19.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
137622025-08-01T16:12:19.763ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137632025-08-01T16:12:19.764ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137642025-08-01T16:12:19.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
137652025-08-01T16:12:19.765ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
137662025-08-01T16:12:19.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
137672025-08-01T16:12:19.766ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.017283ms iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
137682025-08-01T16:12:19.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137692025-08-01T16:12:19.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
137702025-08-01T16:12:19.766ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
137712025-08-01T16:12:19.766ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137722025-08-01T16:12:19.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
137732025-08-01T16:12:19.767ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
137742025-08-01T16:12:19.767ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
137752025-08-01T16:12:19.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
137762025-08-01T16:12:19.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
137772025-08-01T16:12:19.768ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 10.316452ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
137782025-08-01T16:12:19.768ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
137792025-08-01T16:12:19.768ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 10.403506ms iteration = 175 status = {"chicken_switches_updated":false}
137802025-08-01T16:12:19.768ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
137812025-08-01T16:12:19.768ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
137822025-08-01T16:12:19.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
137832025-08-01T16:12:19.768ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
137842025-08-01T16:12:19.768ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 10.648843ms iteration = 30 status = {"errors":[],"requests_created_ok":[]}
137852025-08-01T16:12:19.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
137862025-08-01T16:12:19.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
137872025-08-01T16:12:19.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
137882025-08-01T16:12:19.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
137892025-08-01T16:12:19.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
137902025-08-01T16:12:19.769ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
137912025-08-01T16:12:19.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
137922025-08-01T16:12:19.769ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44435, tv_nsec: 786350216 } })
137932025-08-01T16:12:19.769ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
137942025-08-01T16:12:19.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
137952025-08-01T16:12:19.770ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
137962025-08-01T16:12:19.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
137972025-08-01T16:12:19.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
137982025-08-01T16:12:19.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137992025-08-01T16:12:19.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
138002025-08-01T16:12:19.771ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138012025-08-01T16:12:19.771ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
138022025-08-01T16:12:19.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
138032025-08-01T16:12:19.775ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
138042025-08-01T16:12:19.775ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
138052025-08-01T16:12:19.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
138062025-08-01T16:12:19.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
138072025-08-01T16:12:19.776ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
138082025-08-01T16:12:19.776ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 18.419118ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
138092025-08-01T16:12:19.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
138102025-08-01T16:12:19.778ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
138112025-08-01T16:12:19.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
138122025-08-01T16:12:19.809ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
138132025-08-01T16:12:19.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
138142025-08-01T16:12:19.812ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 125.053522ms iteration = 30 status = null
138152025-08-01T16:12:19.815ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
138162025-08-01T16:12:19.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
138172025-08-01T16:12:19.816ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
138182025-08-01T16:12:19.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
138192025-08-01T16:12:19.817ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 59.470664ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
138202025-08-01T16:12:19.817ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
138212025-08-01T16:12:19.817ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
138222025-08-01T16:12:19.817ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
138232025-08-01T16:12:19.817ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 59.482744ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
138242025-08-01T16:12:19.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
138252025-08-01T16:12:19.818ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138262025-08-01T16:12:19.818ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
138272025-08-01T16:12:19.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
138282025-08-01T16:12:19.821ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
138292025-08-01T16:12:19.821ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
138302025-08-01T16:12:19.821ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
138312025-08-01T16:12:19.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
138322025-08-01T16:12:19.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
138332025-08-01T16:12:19.822ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:391
138342025-08-01T16:12:19.822ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 63.145824ms iteration = 30 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
138352025-08-01T16:12:19.827ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138362025-08-01T16:12:19.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138372025-08-01T16:12:19.831ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 73.110157ms iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
138382025-08-01T16:12:19.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
138392025-08-01T16:12:19.832ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
138402025-08-01T16:12:19.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
138412025-08-01T16:12:19.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
138422025-08-01T16:12:19.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
138432025-08-01T16:12:19.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
138442025-08-01T16:12:19.854ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 96.331321ms iteration = 33 status = {"physical_disks_added":0}
138452025-08-01T16:12:19.861ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
138462025-08-01T16:12:19.861ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 101.824647ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
138472025-08-01T16:12:19.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fec0ef31-ef44-4f3d-ac2f-291de9469d4a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
138482025-08-01T16:12:19.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fec0ef31-ef44-4f3d-ac2f-291de9469d4a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
138492025-08-01T16:12:19.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3070 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fec0ef31-ef44-4f3d-ac2f-291de9469d4a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
138502025-08-01T16:12:19.870ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138512025-08-01T16:12:19.872ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
138522025-08-01T16:12:19.872ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
138532025-08-01T16:12:19.872ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
138542025-08-01T16:12:19.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
138552025-08-01T16:12:19.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
138562025-08-01T16:12:19.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
138572025-08-01T16:12:19.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
138582025-08-01T16:12:19.875ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 118.014978ms iteration = 30 status = 0
138592025-08-01T16:12:19.878ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 191.049323ms iteration = 30 status = {}
138602025-08-01T16:12:19.894ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 zone_address = fd00:1122:3344:101::2
138612025-08-01T16:12:19.894ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
138622025-08-01T16:12:19.894ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a86f9845-74db-4ca7-a5ce-0642a0a04d45", "content-length": "26", "date": "Fri, 01 Aug 2025 16:12:19 GMT"} })
138632025-08-01T16:12:19.894ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
138642025-08-01T16:12:19.896ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
138652025-08-01T16:12:19.919ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
138662025-08-01T16:12:19.919ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 645 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 0e7da2fe-6f00-43d3-8e9d-06de55c34a46 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
138672025-08-01T16:12:19.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
138682025-08-01T16:12:19.920ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
138692025-08-01T16:12:19.920ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
138702025-08-01T16:12:19.920ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 162.311542ms iteration = 31 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
138712025-08-01T16:12:19.921ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138722025-08-01T16:12:19.924ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
138732025-08-01T16:12:19.924ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
138742025-08-01T16:12:19.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
138752025-08-01T16:12:19.935ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
138762025-08-01T16:12:19.935ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
138772025-08-01T16:12:19.936ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c642835-5509-4a74-9c6f-b31038daa091", "content-length": "372", "date": "Fri, 01 Aug 2025 16:12:19 GMT"} })
138782025-08-01T16:12:19.936ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
138792025-08-01T16:12:19.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
138802025-08-01T16:12:19.964ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138812025-08-01T16:12:19.966ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
138822025-08-01T16:12:19.966ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
138832025-08-01T16:12:19.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
138842025-08-01T16:12:19.993ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
138852025-08-01T16:12:19.993ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
138862025-08-01T16:12:19.993ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fb994cf4-b0ca-43a1-b3b9-6dbf101896bf", "date": "Fri, 01 Aug 2025 16:12:19 GMT"} })
138872025-08-01T16:12:19.993ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
138882025-08-01T16:12:19.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
138892025-08-01T16:12:19.995ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
138902025-08-01T16:12:19.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
138912025-08-01T16:12:19.999ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
138922025-08-01T16:12:20.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
138932025-08-01T16:12:20.003ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
138942025-08-01T16:12:20.003ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
138952025-08-01T16:12:20.004ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "413d9db8-51cb-46df-9458-31d9df4db83f", "date": "Fri, 01 Aug 2025 16:12:19 GMT"} })
138962025-08-01T16:12:20.005ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 247.881707ms iteration = 31 status = {}
138972025-08-01T16:12:20.018ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
138982025-08-01T16:12:20.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
138992025-08-01T16:12:20.020ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 3f21d9d5-3adf-463a-a05d-bc2e2e5d64ca, rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(4c7da70d-ede0-4107-abc5-5650a053be38) } rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
139002025-08-01T16:12:20.020ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139012025-08-01T16:12:20.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139022025-08-01T16:12:20.030ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
139032025-08-01T16:12:20.030ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 4c7da70d-ede0-4107-abc5-5650a053be38
139042025-08-01T16:12:20.031ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
139052025-08-01T16:12:20.031ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
139062025-08-01T16:12:20.031ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
139072025-08-01T16:12:20.031ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
139082025-08-01T16:12:20.031ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
139092025-08-01T16:12:20.031ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
139102025-08-01T16:12:20.031ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
139112025-08-01T16:12:20.031ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
139122025-08-01T16:12:20.031ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
139132025-08-01T16:12:20.031ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139142025-08-01T16:12:20.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139152025-08-01T16:12:20.033ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
139162025-08-01T16:12:20.033ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
139172025-08-01T16:12:20.075ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
139182025-08-01T16:12:20.076ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "91a8df87-4f25-49e9-91ad-03e9e3527c68", "content-length": "691", "date": "Fri, 01 Aug 2025 16:12:20 GMT"} })
139192025-08-01T16:12:20.076ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
139202025-08-01T16:12:20.076ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
139212025-08-01T16:12:20.076ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
139222025-08-01T16:12:20.078ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 320.960532ms iteration = 31 status = {}
139232025-08-01T16:12:20.242ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "45d18ba7-d68c-4c7d-8308-0595613514a5", "date": "Fri, 01 Aug 2025 16:12:19 GMT"} })
139242025-08-01T16:12:20.242ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch = Switch0
139252025-08-01T16:12:20.242ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
139262025-08-01T16:12:20.243ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb0a41a2-b0a9-4eb6-baf4-0bb0fb976187", "content-length": "682", "date": "Fri, 01 Aug 2025 16:12:19 GMT"} })
139272025-08-01T16:12:20.243ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139282025-08-01T16:12:20.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139292025-08-01T16:12:20.247ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139302025-08-01T16:12:20.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139312025-08-01T16:12:20.251ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139322025-08-01T16:12:20.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139332025-08-01T16:12:20.253ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139342025-08-01T16:12:20.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139352025-08-01T16:12:20.260ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 502.381302ms iteration = 30 status = {}
139362025-08-01T16:12:20.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 621e1905-601e-4343-8c22-955be1b976a5 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
139372025-08-01T16:12:20.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 621e1905-601e-4343-8c22-955be1b976a5 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
139382025-08-01T16:12:20.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2843 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 621e1905-601e-4343-8c22-955be1b976a5 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
139392025-08-01T16:12:21.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b800646e-c0d9-426b-84af-2460247f78b4 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
139402025-08-01T16:12:21.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b800646e-c0d9-426b-84af-2460247f78b4 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
139412025-08-01T16:12:21.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2753 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b800646e-c0d9-426b-84af-2460247f78b4 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
139422025-08-01T16:12:22.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = eb1931e5-cc43-4bea-988f-10e71b35e3dc roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
139432025-08-01T16:12:22.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = eb1931e5-cc43-4bea-988f-10e71b35e3dc resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
139442025-08-01T16:12:22.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2111 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = eb1931e5-cc43-4bea-988f-10e71b35e3dc response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
139452025-08-01T16:12:23.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6ad7428f-3e5d-4c56-b3fa-ce1ece493342 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
139462025-08-01T16:12:23.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6ad7428f-3e5d-4c56-b3fa-ce1ece493342 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
139472025-08-01T16:12:23.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2359 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6ad7428f-3e5d-4c56-b3fa-ce1ece493342 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
139482025-08-01T16:12:24.757ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 176 reason = Timeout
139492025-08-01T16:12:24.757ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
139502025-08-01T16:12:24.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
139512025-08-01T16:12:24.792ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139522025-08-01T16:12:24.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
139532025-08-01T16:12:24.795ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
139542025-08-01T16:12:24.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
139552025-08-01T16:12:24.797ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
139562025-08-01T16:12:24.797ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 40.237541ms iteration = 176 status = {"chicken_switches_updated":false}
139572025-08-01T16:12:24.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 97f0f5b1-523b-4e15-8c90-0be00f44a4c3 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
139582025-08-01T16:12:24.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 97f0f5b1-523b-4e15-8c90-0be00f44a4c3 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
139592025-08-01T16:12:24.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2377 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 97f0f5b1-523b-4e15-8c90-0be00f44a4c3 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
139602025-08-01T16:12:25.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 47977d0d-0235-483a-84b7-7cfd6635dde4 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
139612025-08-01T16:12:25.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 47977d0d-0235-483a-84b7-7cfd6635dde4 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
139622025-08-01T16:12:25.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2057 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 47977d0d-0235-483a-84b7-7cfd6635dde4 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
139632025-08-01T16:12:26.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 14bab4f5-448c-4b9a-b65e-9ec1df3cf9a9 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
139642025-08-01T16:12:26.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 14bab4f5-448c-4b9a-b65e-9ec1df3cf9a9 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
139652025-08-01T16:12:26.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2212 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 14bab4f5-448c-4b9a-b65e-9ec1df3cf9a9 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
139662025-08-01T16:12:27.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2985759b-1688-4b1c-b3c2-fc4274a5eb23 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
139672025-08-01T16:12:27.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2985759b-1688-4b1c-b3c2-fc4274a5eb23 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
139682025-08-01T16:12:28.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2788 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2985759b-1688-4b1c-b3c2-fc4274a5eb23 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
139692025-08-01T16:12:29.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 311b660c-9f48-4a09-b576-5afcacde7086 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
139702025-08-01T16:12:29.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 311b660c-9f48-4a09-b576-5afcacde7086 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
139712025-08-01T16:12:29.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2446 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 311b660c-9f48-4a09-b576-5afcacde7086 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
139722025-08-01T16:12:29.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
139732025-08-01T16:12:29.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 177 reason = Timeout
139742025-08-01T16:12:29.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
139752025-08-01T16:12:29.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
139762025-08-01T16:12:29.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
139772025-08-01T16:12:29.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
139782025-08-01T16:12:29.758ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
139792025-08-01T16:12:29.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139802025-08-01T16:12:29.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139812025-08-01T16:12:29.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139822025-08-01T16:12:29.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
139832025-08-01T16:12:29.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
139842025-08-01T16:12:29.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
139852025-08-01T16:12:29.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
139862025-08-01T16:12:29.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.352703ms iteration = 177 status = {"chicken_switches_updated":false}
139872025-08-01T16:12:29.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139882025-08-01T16:12:29.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
139892025-08-01T16:12:29.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
139902025-08-01T16:12:29.798ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.024773ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
139912025-08-01T16:12:29.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
139922025-08-01T16:12:29.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139932025-08-01T16:12:29.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139942025-08-01T16:12:29.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139952025-08-01T16:12:29.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139962025-08-01T16:12:29.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139972025-08-01T16:12:29.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
139982025-08-01T16:12:29.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139992025-08-01T16:12:29.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
140002025-08-01T16:12:29.820ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
140012025-08-01T16:12:29.820ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 61.306879ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
140022025-08-01T16:12:29.912ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::d]:52164
140032025-08-01T16:12:29.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52164 req_id = 4a916a2e-faba-405b-a9a1-6e690f3a9516 roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
140042025-08-01T16:12:29.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52164 req_id = 4a916a2e-faba-405b-a9a1-6e690f3a9516 resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
140052025-08-01T16:12:29.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2798 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52164 req_id = 4a916a2e-faba-405b-a9a1-6e690f3a9516 response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
140062025-08-01T16:12:29.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52164 req_id = 1aa33331-cdab-4f5f-ad7e-134274932a84 roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
140072025-08-01T16:12:29.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52164 req_id = 1aa33331-cdab-4f5f-ad7e-134274932a84 resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
140082025-08-01T16:12:29.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1912 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52164 req_id = 1aa33331-cdab-4f5f-ad7e-134274932a84 response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
140092025-08-01T16:12:29.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 672 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 4b8875c0-9463-4437-b217-c4b07b34c13a response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
140102025-08-01T16:12:30.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b563d077-5305-486a-a410-441999cddf77 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140112025-08-01T16:12:30.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b563d077-5305-486a-a410-441999cddf77 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140122025-08-01T16:12:30.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2431 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b563d077-5305-486a-a410-441999cddf77 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140132025-08-01T16:12:31.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3215a27e-b0a4-469e-b1dd-5b9dd5c9f4e0 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140142025-08-01T16:12:31.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3215a27e-b0a4-469e-b1dd-5b9dd5c9f4e0 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140152025-08-01T16:12:31.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2283 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3215a27e-b0a4-469e-b1dd-5b9dd5c9f4e0 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140162025-08-01T16:12:32.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ab406576-7a2c-4feb-923f-aeee7a5469b8 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140172025-08-01T16:12:32.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ab406576-7a2c-4feb-923f-aeee7a5469b8 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140182025-08-01T16:12:32.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2749 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ab406576-7a2c-4feb-923f-aeee7a5469b8 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140192025-08-01T16:12:33.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c10bc7e7-9358-4bab-a325-7409e36e622c roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140202025-08-01T16:12:33.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c10bc7e7-9358-4bab-a325-7409e36e622c resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140212025-08-01T16:12:33.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2072 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c10bc7e7-9358-4bab-a325-7409e36e622c response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140222025-08-01T16:12:34.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8665681a-3468-48ea-b35c-0e561a272768 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140232025-08-01T16:12:34.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8665681a-3468-48ea-b35c-0e561a272768 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140242025-08-01T16:12:34.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3153 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8665681a-3468-48ea-b35c-0e561a272768 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140252025-08-01T16:12:34.757ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 178 reason = Timeout
140262025-08-01T16:12:34.757ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
140272025-08-01T16:12:34.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
140282025-08-01T16:12:34.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140292025-08-01T16:12:34.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
140302025-08-01T16:12:34.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
140312025-08-01T16:12:34.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
140322025-08-01T16:12:34.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
140332025-08-01T16:12:34.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.985262ms iteration = 178 status = {"chicken_switches_updated":false}
140342025-08-01T16:12:35.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 80ade0d5-17af-45a8-9e9d-b199bbb7cb6d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140352025-08-01T16:12:35.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 80ade0d5-17af-45a8-9e9d-b199bbb7cb6d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140362025-08-01T16:12:35.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2495 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 80ade0d5-17af-45a8-9e9d-b199bbb7cb6d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140372025-08-01T16:12:36.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b216818a-2fe8-4386-892d-56a540a8e8da roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140382025-08-01T16:12:36.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b216818a-2fe8-4386-892d-56a540a8e8da resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140392025-08-01T16:12:36.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2371 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b216818a-2fe8-4386-892d-56a540a8e8da response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140402025-08-01T16:12:37.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dc2a9c10-b7a8-4012-9cf6-d977e1d6e85d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140412025-08-01T16:12:37.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dc2a9c10-b7a8-4012-9cf6-d977e1d6e85d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140422025-08-01T16:12:37.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2903 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dc2a9c10-b7a8-4012-9cf6-d977e1d6e85d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140432025-08-01T16:12:38.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5578e793-3637-46d3-8709-84af58d096fe roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140442025-08-01T16:12:38.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5578e793-3637-46d3-8709-84af58d096fe resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140452025-08-01T16:12:38.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2444 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5578e793-3637-46d3-8709-84af58d096fe response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140462025-08-01T16:12:39.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1dc9016b-c4fa-4e67-8fc3-14026671353f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140472025-08-01T16:12:39.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1dc9016b-c4fa-4e67-8fc3-14026671353f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140482025-08-01T16:12:39.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1842 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1dc9016b-c4fa-4e67-8fc3-14026671353f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140492025-08-01T16:12:39.757ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 90 reason = Timeout
140502025-08-01T16:12:39.757ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
140512025-08-01T16:12:39.757ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 179 reason = Timeout
140522025-08-01T16:12:39.757ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
140532025-08-01T16:12:39.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
140542025-08-01T16:12:39.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
140552025-08-01T16:12:39.758ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 90 reason = Timeout
140562025-08-01T16:12:39.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
140572025-08-01T16:12:39.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
140582025-08-01T16:12:39.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140592025-08-01T16:12:39.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
140602025-08-01T16:12:39.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
140612025-08-01T16:12:39.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
140622025-08-01T16:12:39.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
140632025-08-01T16:12:39.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.609311ms iteration = 179 status = {"chicken_switches_updated":false}
140642025-08-01T16:12:39.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140652025-08-01T16:12:39.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
140662025-08-01T16:12:39.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
140672025-08-01T16:12:39.800ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 42.664714ms iteration = 90 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
140682025-08-01T16:12:39.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
140692025-08-01T16:12:39.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
140702025-08-01T16:12:39.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
140712025-08-01T16:12:39.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
140722025-08-01T16:12:39.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
140732025-08-01T16:12:39.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140742025-08-01T16:12:39.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
140752025-08-01T16:12:39.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
140762025-08-01T16:12:39.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
140772025-08-01T16:12:39.831ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
140782025-08-01T16:12:39.831ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 72.367244ms iteration = 90 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
140792025-08-01T16:12:39.919ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 566 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 53738bfb-801c-4a92-907d-cd0cdff3e4a4 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
140802025-08-01T16:12:40.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 76fcee5d-765b-4f85-83d8-5a861dbc62d2 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140812025-08-01T16:12:40.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 76fcee5d-765b-4f85-83d8-5a861dbc62d2 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140822025-08-01T16:12:40.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2428 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 76fcee5d-765b-4f85-83d8-5a861dbc62d2 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140832025-08-01T16:12:41.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5deb3fb7-17f9-4ad6-be74-8717a242876e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140842025-08-01T16:12:41.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5deb3fb7-17f9-4ad6-be74-8717a242876e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140852025-08-01T16:12:41.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2444 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5deb3fb7-17f9-4ad6-be74-8717a242876e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140862025-08-01T16:12:42.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 69d547e7-8946-4ec7-a396-76c6cb747596 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140872025-08-01T16:12:42.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 69d547e7-8946-4ec7-a396-76c6cb747596 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140882025-08-01T16:12:42.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2770 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 69d547e7-8946-4ec7-a396-76c6cb747596 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140892025-08-01T16:12:43.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e0a80c30-9822-43a8-ae21-406bade78ab2 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140902025-08-01T16:12:43.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e0a80c30-9822-43a8-ae21-406bade78ab2 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140912025-08-01T16:12:43.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2437 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = e0a80c30-9822-43a8-ae21-406bade78ab2 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140922025-08-01T16:12:44.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7ea8a1e4-159f-4a38-be17-cd4a3335152e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140932025-08-01T16:12:44.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7ea8a1e4-159f-4a38-be17-cd4a3335152e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140942025-08-01T16:12:44.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2779 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7ea8a1e4-159f-4a38-be17-cd4a3335152e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
140952025-08-01T16:12:44.757ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 180 reason = Timeout
140962025-08-01T16:12:44.757ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
140972025-08-01T16:12:44.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
140982025-08-01T16:12:44.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140992025-08-01T16:12:44.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
141002025-08-01T16:12:44.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
141012025-08-01T16:12:44.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
141022025-08-01T16:12:44.764ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
141032025-08-01T16:12:44.764ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.394214ms iteration = 180 status = {"chicken_switches_updated":false}
141042025-08-01T16:12:45.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fe5820c0-8f91-4441-9a05-0b3a6f805a6a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
141052025-08-01T16:12:45.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fe5820c0-8f91-4441-9a05-0b3a6f805a6a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
141062025-08-01T16:12:45.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2749 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = fe5820c0-8f91-4441-9a05-0b3a6f805a6a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
141072025-08-01T16:12:46.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 52e9ccc8-8740-4970-90c9-7963e7b202df roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
141082025-08-01T16:12:46.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 52e9ccc8-8740-4970-90c9-7963e7b202df resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
141092025-08-01T16:12:46.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2725 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 52e9ccc8-8740-4970-90c9-7963e7b202df response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
141102025-08-01T16:12:47.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 84a4bea9-6ad7-4bca-a72b-7c77ccd8906a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
141112025-08-01T16:12:47.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 84a4bea9-6ad7-4bca-a72b-7c77ccd8906a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
141122025-08-01T16:12:47.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2893 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 84a4bea9-6ad7-4bca-a72b-7c77ccd8906a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
141132025-08-01T16:12:48.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 24c83b5a-2f85-4326-96f9-aa26660271ec roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
141142025-08-01T16:12:48.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 24c83b5a-2f85-4326-96f9-aa26660271ec resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
141152025-08-01T16:12:48.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2384 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 24c83b5a-2f85-4326-96f9-aa26660271ec response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
141162025-08-01T16:12:49.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2c6b5cce-e120-4fc4-9b17-20cbdbdeda58 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
141172025-08-01T16:12:49.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2c6b5cce-e120-4fc4-9b17-20cbdbdeda58 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
141182025-08-01T16:12:49.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2234 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2c6b5cce-e120-4fc4-9b17-20cbdbdeda58 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
141192025-08-01T16:12:49.686ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
141202025-08-01T16:12:49.686ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
141212025-08-01T16:12:49.686ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
141222025-08-01T16:12:49.687ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 16 reason = Timeout
141232025-08-01T16:12:49.687ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-01 16:02:49.686954454 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
141242025-08-01T16:12:49.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
141252025-08-01T16:12:49.687ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 31 reason = Timeout
141262025-08-01T16:12:49.687ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
141272025-08-01T16:12:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 18 reason = Timeout
141282025-08-01T16:12:49.687ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 31 reason = Timeout
141292025-08-01T16:12:49.687ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
141302025-08-01T16:12:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
141312025-08-01T16:12:49.687ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
141322025-08-01T16:12:49.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
141332025-08-01T16:12:49.687ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
141342025-08-01T16:12:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
141352025-08-01T16:12:49.687ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
141362025-08-01T16:12:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 18 reason = Timeout
141372025-08-01T16:12:49.687ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 31 reason = Timeout
141382025-08-01T16:12:49.687ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
141392025-08-01T16:12:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
141402025-08-01T16:12:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
141412025-08-01T16:12:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
141422025-08-01T16:12:49.687ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50fe31de-3241-42df-a386-de37ce323a34.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("58598327-8751-423c-a5ac-c610829651e2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 44465, tv_nsec: 704647625 } })
141432025-08-01T16:12:49.687ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cb706a84-a33b-442f-aac2-3a6eb5f3b330.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d688a68d-d771-4ac5-8e66-9efa94dbbea8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d688a68d-d771-4ac5-8e66-9efa94dbbea8.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 44465, tv_nsec: 704668705 } })
141442025-08-01T16:12:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
141452025-08-01T16:12:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
141462025-08-01T16:12:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
141472025-08-01T16:12:49.688ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
141482025-08-01T16:12:49.688ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
141492025-08-01T16:12:49.688ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.098014ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
141502025-08-01T16:12:49.688ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 943.399\u{b5}s iteration = 16 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
141512025-08-01T16:12:49.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
141522025-08-01T16:12:49.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
141532025-08-01T16:12:49.689ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
141542025-08-01T16:12:49.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
141552025-08-01T16:12:49.689ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-01 16:02:49.686954454 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
141562025-08-01T16:12:49.689ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.831786ms iteration = 16 status = {"expiration":"2025-08-01T16:02:49.686954454Z","pruned":[]}
141572025-08-01T16:12:49.690ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44465, tv_nsec: 707724438 } })
141582025-08-01T16:12:49.690ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.818806ms iteration = 31 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
141592025-08-01T16:12:49.690ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
141602025-08-01T16:12:49.692ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44465, tv_nsec: 709484671 } })
141612025-08-01T16:12:49.692ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141622025-08-01T16:12:49.692ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
141632025-08-01T16:12:49.693ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141642025-08-01T16:12:49.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
141652025-08-01T16:12:49.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
141662025-08-01T16:12:49.706ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 17 reason = Timeout
141672025-08-01T16:12:49.706ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1
141682025-08-01T16:12:49.706ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 25.31\u{b5}s iteration = 17 status = {"enabled":false,"target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1"}
141692025-08-01T16:12:49.709ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 7 reason = Timeout
141702025-08-01T16:12:49.709ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 7 reason = Timeout
141712025-08-01T16:12:49.709ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
141722025-08-01T16:12:49.709ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 20 reason = Timeout
141732025-08-01T16:12:49.709ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
141742025-08-01T16:12:49.709ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 9.8\u{b5}s iteration = 20 status = "Disabled"
141752025-08-01T16:12:49.709ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
141762025-08-01T16:12:49.709ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 4 reason = Timeout
141772025-08-01T16:12:49.709ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 16 reason = Timeout
141782025-08-01T16:12:49.709ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
141792025-08-01T16:12:49.709ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
141802025-08-01T16:12:49.709ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 16 reason = Timeout
141812025-08-01T16:12:49.709ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 16 reason = Timeout
141822025-08-01T16:12:49.709ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
141832025-08-01T16:12:49.709ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
141842025-08-01T16:12:49.709ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
141852025-08-01T16:12:49.709ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 16 reason = Timeout
141862025-08-01T16:12:49.709ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
141872025-08-01T16:12:49.709ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 16 reason = Timeout
141882025-08-01T16:12:49.709ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 4 reason = Timeout
141892025-08-01T16:12:49.709ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
141902025-08-01T16:12:49.709ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
141912025-08-01T16:12:49.709ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
141922025-08-01T16:12:49.709ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 16 reason = Timeout
141932025-08-01T16:12:49.709ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
141942025-08-01T16:12:49.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
141952025-08-01T16:12:49.710ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
141962025-08-01T16:12:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
141972025-08-01T16:12:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
141982025-08-01T16:12:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
141992025-08-01T16:12:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
142002025-08-01T16:12:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
142012025-08-01T16:12:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
142022025-08-01T16:12:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
142032025-08-01T16:12:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
142042025-08-01T16:12:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
142052025-08-01T16:12:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
142062025-08-01T16:12:49.710ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
142072025-08-01T16:12:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
142082025-08-01T16:12:49.710ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
142092025-08-01T16:12:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
142102025-08-01T16:12:49.710ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
142112025-08-01T16:12:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
142122025-08-01T16:12:49.712ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142132025-08-01T16:12:49.713ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142142025-08-01T16:12:49.713ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142152025-08-01T16:12:49.715ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
142162025-08-01T16:12:49.715ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 5.953281ms iteration = 16 status = {"by_rx":{},"error":null}
142172025-08-01T16:12:49.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
142182025-08-01T16:12:49.716ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
142192025-08-01T16:12:49.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
142202025-08-01T16:12:49.717ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.395284ms iteration = 16 status = {"errors":[],"found_port_ok":[]}
142212025-08-01T16:12:49.717ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
142222025-08-01T16:12:49.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
142232025-08-01T16:12:49.717ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
142242025-08-01T16:12:49.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
142252025-08-01T16:12:49.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
142262025-08-01T16:12:49.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
142272025-08-01T16:12:49.720ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
142282025-08-01T16:12:49.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
142292025-08-01T16:12:49.723ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
142302025-08-01T16:12:49.723ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
142312025-08-01T16:12:49.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
142322025-08-01T16:12:49.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
142332025-08-01T16:12:49.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
142342025-08-01T16:12:49.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
142352025-08-01T16:12:49.726ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
142362025-08-01T16:12:49.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
142372025-08-01T16:12:49.727ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 17.645945ms iteration = 16 status = {"dispatched":[],"errors":[],"glob_version":"173.0.0","globs_reprocessed":{},"no_receivers":[]}
142382025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 31 reason = Timeout
142392025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
142402025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 23.341\u{b5}s iteration = 31 status = {"disabled":true,"errors":[],"sps":[]}
142412025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 31 reason = Timeout
142422025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
142432025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
142442025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 32 reason = Timeout
142452025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
142462025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 91 reason = Timeout
142472025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 181 reason = Timeout
142482025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
142492025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
142502025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 32 reason = Timeout
142512025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
142522025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
142532025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 31 reason = Timeout
142542025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
142552025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
142562025-08-01T16:12:49.758ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
142572025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 31 reason = Timeout
142582025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
142592025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 31 reason = Timeout
142602025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
142612025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
142622025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 31 reason = Timeout
142632025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
142642025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 31 reason = Timeout
142652025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
142662025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 31 reason = Timeout
142672025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
142682025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 31 reason = Timeout
142692025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
142702025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 31 reason = Timeout
142712025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
142722025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 31 reason = Timeout
142732025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
142742025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 91 reason = Timeout
142752025-08-01T16:12:49.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142762025-08-01T16:12:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
142772025-08-01T16:12:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
142782025-08-01T16:12:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
142792025-08-01T16:12:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
142802025-08-01T16:12:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
142812025-08-01T16:12:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
142822025-08-01T16:12:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
142832025-08-01T16:12:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
142842025-08-01T16:12:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
142852025-08-01T16:12:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
142862025-08-01T16:12:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
142872025-08-01T16:12:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
142882025-08-01T16:12:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
142892025-08-01T16:12:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
142902025-08-01T16:12:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
142912025-08-01T16:12:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
142922025-08-01T16:12:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142932025-08-01T16:12:49.767ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142942025-08-01T16:12:49.767ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142952025-08-01T16:12:49.770ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
142962025-08-01T16:12:49.770ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
142972025-08-01T16:12:49.770ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
142982025-08-01T16:12:49.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
142992025-08-01T16:12:49.771ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
143002025-08-01T16:12:49.771ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
143012025-08-01T16:12:49.771ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
143022025-08-01T16:12:49.771ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
143032025-08-01T16:12:49.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
143042025-08-01T16:12:49.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
143052025-08-01T16:12:49.772ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
143062025-08-01T16:12:49.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
143072025-08-01T16:12:49.772ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143082025-08-01T16:12:49.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
143092025-08-01T16:12:49.773ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
143102025-08-01T16:12:49.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
143112025-08-01T16:12:49.777ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
143122025-08-01T16:12:49.777ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
143132025-08-01T16:12:49.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
143142025-08-01T16:12:49.778ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143152025-08-01T16:12:49.779ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143162025-08-01T16:12:49.782ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143172025-08-01T16:12:49.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
143182025-08-01T16:12:49.783ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
143192025-08-01T16:12:49.783ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 24.431841ms iteration = 31 status = {"errors":[],"requests_created_ok":[]}
143202025-08-01T16:12:49.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
143212025-08-01T16:12:49.783ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
143222025-08-01T16:12:49.783ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
143232025-08-01T16:12:49.783ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
143242025-08-01T16:12:49.783ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
143252025-08-01T16:12:49.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
143262025-08-01T16:12:49.784ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
143272025-08-01T16:12:49.784ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
143282025-08-01T16:12:49.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
143292025-08-01T16:12:49.785ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143302025-08-01T16:12:49.785ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
143312025-08-01T16:12:49.785ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
143322025-08-01T16:12:49.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
143332025-08-01T16:12:49.785ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143342025-08-01T16:12:49.787ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143352025-08-01T16:12:49.787ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143362025-08-01T16:12:49.789ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143372025-08-01T16:12:49.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
143382025-08-01T16:12:49.790ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
143392025-08-01T16:12:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
143402025-08-01T16:12:49.791ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
143412025-08-01T16:12:49.791ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
143422025-08-01T16:12:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
143432025-08-01T16:12:49.791ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44465, tv_nsec: 808736071 } })
143442025-08-01T16:12:49.791ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
143452025-08-01T16:12:49.791ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
143462025-08-01T16:12:49.791ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 82.289955ms iteration = 16 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
143472025-08-01T16:12:49.791ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
143482025-08-01T16:12:49.792ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 33.490735ms iteration = 181 status = {"chicken_switches_updated":false}
143492025-08-01T16:12:49.792ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
143502025-08-01T16:12:49.792ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
143512025-08-01T16:12:49.792ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
143522025-08-01T16:12:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
143532025-08-01T16:12:49.793ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143542025-08-01T16:12:49.793ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143552025-08-01T16:12:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
143562025-08-01T16:12:49.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
143572025-08-01T16:12:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
143582025-08-01T16:12:49.794ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143592025-08-01T16:12:49.796ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
143602025-08-01T16:12:49.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
143612025-08-01T16:12:49.796ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
143622025-08-01T16:12:49.796ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
143632025-08-01T16:12:49.796ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
143642025-08-01T16:12:49.796ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
143652025-08-01T16:12:49.796ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 87.354418ms iteration = 16 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
143662025-08-01T16:12:49.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
143672025-08-01T16:12:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
143682025-08-01T16:12:49.797ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
143692025-08-01T16:12:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
143702025-08-01T16:12:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
143712025-08-01T16:12:49.798ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
143722025-08-01T16:12:49.798ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143732025-08-01T16:12:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
143742025-08-01T16:12:49.798ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143752025-08-01T16:12:49.799ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
143762025-08-01T16:12:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
143772025-08-01T16:12:49.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
143782025-08-01T16:12:49.801ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143792025-08-01T16:12:49.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
143802025-08-01T16:12:49.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
143812025-08-01T16:12:49.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
143822025-08-01T16:12:49.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
143832025-08-01T16:12:49.803ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
143842025-08-01T16:12:49.803ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
143852025-08-01T16:12:49.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
143862025-08-01T16:12:49.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
143872025-08-01T16:12:49.803ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
143882025-08-01T16:12:49.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
143892025-08-01T16:12:49.803ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143902025-08-01T16:12:49.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
143912025-08-01T16:12:49.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
143922025-08-01T16:12:49.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
143932025-08-01T16:12:49.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
143942025-08-01T16:12:49.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
143952025-08-01T16:12:49.807ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
143962025-08-01T16:12:49.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
143972025-08-01T16:12:49.807ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
143982025-08-01T16:12:49.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
143992025-08-01T16:12:49.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
144002025-08-01T16:12:49.808ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
144012025-08-01T16:12:49.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
144022025-08-01T16:12:49.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144032025-08-01T16:12:49.818ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
144042025-08-01T16:12:49.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
144052025-08-01T16:12:49.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
144062025-08-01T16:12:49.827ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144072025-08-01T16:12:49.829ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144082025-08-01T16:12:49.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
144092025-08-01T16:12:49.830ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
144102025-08-01T16:12:49.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
144112025-08-01T16:12:49.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
144122025-08-01T16:12:49.836ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
144132025-08-01T16:12:49.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
144142025-08-01T16:12:49.844ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 85.959996ms iteration = 31 status = {"errors":[],"garbage_collect_requested":[]}
144152025-08-01T16:12:49.849ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
144162025-08-01T16:12:49.849ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
144172025-08-01T16:12:49.850ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a9ab45a-26c9-46cf-a652-32fc44441560", "content-length": "26", "date": "Fri, 01 Aug 2025 16:12:49 GMT"} })
144182025-08-01T16:12:49.850ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
144192025-08-01T16:12:49.851ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
144202025-08-01T16:12:49.852ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
144212025-08-01T16:12:49.853ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
144222025-08-01T16:12:49.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144232025-08-01T16:12:49.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
144242025-08-01T16:12:49.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 96.015691ms iteration = 31 status = {"errors":[],"finish_invoked_ok":[]}
144252025-08-01T16:12:49.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
144262025-08-01T16:12:49.855ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 145.603584ms iteration = 7 status = {"nsuccess":5}
144272025-08-01T16:12:49.859ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
144282025-08-01T16:12:49.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
144292025-08-01T16:12:49.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
144302025-08-01T16:12:49.859ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
144312025-08-01T16:12:49.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
144322025-08-01T16:12:49.860ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
144332025-08-01T16:12:49.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
144342025-08-01T16:12:49.860ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
144352025-08-01T16:12:49.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
144362025-08-01T16:12:49.861ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
144372025-08-01T16:12:49.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
144382025-08-01T16:12:49.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
144392025-08-01T16:12:49.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
144402025-08-01T16:12:49.864ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144412025-08-01T16:12:49.865ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
144422025-08-01T16:12:49.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
144432025-08-01T16:12:49.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144442025-08-01T16:12:49.867ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
144452025-08-01T16:12:49.867ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
144462025-08-01T16:12:49.867ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
144472025-08-01T16:12:49.867ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144482025-08-01T16:12:49.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
144492025-08-01T16:12:49.867ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b9584d2-e0d6-4622-a277-499d621105cf", "content-length": "26", "date": "Fri, 01 Aug 2025 16:12:49 GMT"} })
144502025-08-01T16:12:49.867ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
144512025-08-01T16:12:49.869ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
144522025-08-01T16:12:49.869ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
144532025-08-01T16:12:49.869ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
144542025-08-01T16:12:49.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
144552025-08-01T16:12:49.869ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
144562025-08-01T16:12:49.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
144572025-08-01T16:12:49.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
144582025-08-01T16:12:49.870ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
144592025-08-01T16:12:49.871ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
144602025-08-01T16:12:49.871ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
144612025-08-01T16:12:49.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
144622025-08-01T16:12:49.872ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
144632025-08-01T16:12:49.872ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
144642025-08-01T16:12:49.872ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 113.499312ms iteration = 32 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
144652025-08-01T16:12:49.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144662025-08-01T16:12:49.874ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
144672025-08-01T16:12:49.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
144682025-08-01T16:12:49.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
144692025-08-01T16:12:49.874ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
144702025-08-01T16:12:49.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
144712025-08-01T16:12:49.877ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144722025-08-01T16:12:49.877ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
144732025-08-01T16:12:49.877ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
144742025-08-01T16:12:49.877ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
144752025-08-01T16:12:49.877ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 119.312378ms iteration = 31 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
144762025-08-01T16:12:49.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
144772025-08-01T16:12:49.879ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
144782025-08-01T16:12:49.879ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
144792025-08-01T16:12:49.879ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6482e44c-c860-4033-b945-5707d343a59d dns_zone_name = oxide.test found_so_far = 0 version = 2
144802025-08-01T16:12:49.879ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
144812025-08-01T16:12:49.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
144822025-08-01T16:12:49.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
144832025-08-01T16:12:49.881ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
144842025-08-01T16:12:49.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
144852025-08-01T16:12:49.881ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
144862025-08-01T16:12:49.881ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 171.8236ms iteration = 7 status = {"blueprint_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","inventory_collection_id":"d1e893ae-a146-4c83-8917-6047ca8ee403","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
144872025-08-01T16:12:49.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
144882025-08-01T16:12:49.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144892025-08-01T16:12:49.882ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
144902025-08-01T16:12:49.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144912025-08-01T16:12:49.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
144922025-08-01T16:12:49.883ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:391
144932025-08-01T16:12:49.883ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 124.552826ms iteration = 31 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
144942025-08-01T16:12:49.885ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
144952025-08-01T16:12:49.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
144962025-08-01T16:12:49.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
144972025-08-01T16:12:49.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
144982025-08-01T16:12:49.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
144992025-08-01T16:12:49.887ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
145002025-08-01T16:12:49.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
145012025-08-01T16:12:49.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
145022025-08-01T16:12:49.888ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
145032025-08-01T16:12:49.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
145042025-08-01T16:12:49.890ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
145052025-08-01T16:12:49.890ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 02fcb774-aa43-4052-9996-b85e2d1358b5 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
145062025-08-01T16:12:49.890ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
145072025-08-01T16:12:49.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
145082025-08-01T16:12:49.890ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6482e44c-c860-4033-b945-5707d343a59d dns_zone_name = oxide.test found_so_far = 4 version = 2
145092025-08-01T16:12:49.890ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
145102025-08-01T16:12:49.890ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-01 15:58:34.713515 UTC dns_group = external generation = 2
145112025-08-01T16:12:49.890ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 203.692016ms iteration = 16 status = {"generation":2}
145122025-08-01T16:12:49.890ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
145132025-08-01T16:12:49.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
145142025-08-01T16:12:49.892ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
145152025-08-01T16:12:49.892ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145162025-08-01T16:12:49.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
145172025-08-01T16:12:49.893ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
145182025-08-01T16:12:49.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
145192025-08-01T16:12:49.894ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145202025-08-01T16:12:49.895ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145212025-08-01T16:12:49.899ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
145222025-08-01T16:12:49.899ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
145232025-08-01T16:12:49.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
145242025-08-01T16:12:49.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
145252025-08-01T16:12:49.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
145262025-08-01T16:12:49.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
145272025-08-01T16:12:49.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
145282025-08-01T16:12:49.900ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
145292025-08-01T16:12:49.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
145302025-08-01T16:12:49.904ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
145312025-08-01T16:12:49.904ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
145322025-08-01T16:12:49.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
145332025-08-01T16:12:49.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
145342025-08-01T16:12:49.909ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 02fcb774-aa43-4052-9996-b85e2d1358b5 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
145352025-08-01T16:12:49.909ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
145362025-08-01T16:12:49.909ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-01 15:58:34.032744 UTC dns_group = internal generation = 1
145372025-08-01T16:12:49.909ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 222.137775ms iteration = 16 status = {"generation":1}
145382025-08-01T16:12:49.911ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
145392025-08-01T16:12:49.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
145402025-08-01T16:12:49.913ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
145412025-08-01T16:12:49.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
145422025-08-01T16:12:49.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145432025-08-01T16:12:49.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
145442025-08-01T16:12:49.919ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
145452025-08-01T16:12:49.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
145462025-08-01T16:12:49.919ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
145472025-08-01T16:12:49.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
145482025-08-01T16:12:49.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 681 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 6d4face5-5180-42e9-b3db-85e06a726807 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
145492025-08-01T16:12:49.921ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
145502025-08-01T16:12:49.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
145512025-08-01T16:12:49.925ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
145522025-08-01T16:12:49.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
145532025-08-01T16:12:49.927ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
145542025-08-01T16:12:49.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
145552025-08-01T16:12:49.929ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 170.677845ms iteration = 31 status = 0
145562025-08-01T16:12:49.929ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
145572025-08-01T16:12:49.929ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145582025-08-01T16:12:49.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
145592025-08-01T16:12:49.932ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
145602025-08-01T16:12:49.932ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 173.578313ms iteration = 91 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
145612025-08-01T16:12:49.933ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 174.49139ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
145622025-08-01T16:12:49.935ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
145632025-08-01T16:12:49.936ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 177.738039ms iteration = 91 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
145642025-08-01T16:12:49.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
145652025-08-01T16:12:49.936ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
145662025-08-01T16:12:49.936ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
145672025-08-01T16:12:49.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
145682025-08-01T16:12:49.938ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
145692025-08-01T16:12:49.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
145702025-08-01T16:12:49.942ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 183.625287ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
145712025-08-01T16:12:49.992ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-01T15:57:44.766264Z, time_modified: 2025-08-01T15:57:44.766264Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: eec17da7-eb17-4917-8728-908698b69bbe, db_silo: Silo { identity: SiloIdentity { id: eec17da7-eb17-4917-8728-908698b69bbe, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-01T15:58:34.653875Z, time_modified: 2025-08-01T15:58:34.653875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: eec17da7-eb17-4917-8728-908698b69bbe, db_silo: Silo { identity: SiloIdentity { id: eec17da7-eb17-4917-8728-908698b69bbe, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-01T15:58:34.653875Z, time_modified: 2025-08-01T15:58:34.653875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575" }] }) }
145722025-08-01T16:12:49.992ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 305.312997ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"eec17da7-eb17-4917-8728-908698b69bbe","tls_certs":["b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575"]}},"default_endpoint":{"silo_id":"eec17da7-eb17-4917-8728-908698b69bbe","tls_certs":["b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
145732025-08-01T16:12:49.993ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 zone_address = fd00:1122:3344:101::2
145742025-08-01T16:12:49.993ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
145752025-08-01T16:12:49.993ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 234.590553ms iteration = 31 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
145762025-08-01T16:12:49.993ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3545671-8566-48f3-9cf3-2ba322b5ad76", "content-length": "26", "date": "Fri, 01 Aug 2025 16:12:49 GMT"} })
145772025-08-01T16:12:49.993ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
145782025-08-01T16:12:50.001ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
145792025-08-01T16:12:50.001ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
145802025-08-01T16:12:50.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
145812025-08-01T16:12:50.001ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
145822025-08-01T16:12:50.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
145832025-08-01T16:12:50.004ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145842025-08-01T16:12:50.008ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
145852025-08-01T16:12:50.008ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
145862025-08-01T16:12:50.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
145872025-08-01T16:12:50.013ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
145882025-08-01T16:12:50.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
145892025-08-01T16:12:50.019ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
145902025-08-01T16:12:50.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
145912025-08-01T16:12:50.022ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
145922025-08-01T16:12:50.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
145932025-08-01T16:12:50.025ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
145942025-08-01T16:12:50.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
145952025-08-01T16:12:50.027ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
145962025-08-01T16:12:50.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
145972025-08-01T16:12:50.029ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
145982025-08-01T16:12:50.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
145992025-08-01T16:12:50.040ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
146002025-08-01T16:12:50.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
146012025-08-01T16:12:50.042ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146022025-08-01T16:12:50.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
146032025-08-01T16:12:50.044ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
146042025-08-01T16:12:50.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
146052025-08-01T16:12:50.046ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
146062025-08-01T16:12:50.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
146072025-08-01T16:12:50.054ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146082025-08-01T16:12:50.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
146092025-08-01T16:12:50.058ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
146102025-08-01T16:12:50.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
146112025-08-01T16:12:50.061ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = tuf_artifact_replication body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/artifacts-config
146122025-08-01T16:12:50.061ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 302.962527ms iteration = 34 status = {"physical_disks_added":0}
146132025-08-01T16:12:50.062ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts-config", status: 204, headers: {"x-request-id": "61720a3b-b7ea-4556-8e99-9ed3f4c90068", "date": "Fri, 01 Aug 2025 16:12:50 GMT"} })
146142025-08-01T16:12:50.062ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
146152025-08-01T16:12:50.062ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "01e868f5-9330-4d86-8a1a-0255e3aa77f2", "content-length": "26", "date": "Fri, 01 Aug 2025 16:12:50 GMT"} })
146162025-08-01T16:12:50.062ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:672 sled = http://[fd00:1122:3344:101::1]:12345
146172025-08-01T16:12:50.064ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 354.957523ms iteration = 4 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":3,"put_config_err":0,"put_config_ok":3,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"generation":1,"operation":"put_config","target_sled":"c9f3bda2-4996-4bda-a233-772410078d0a","time":"2025-08-01T16:02:49.952832654Z"},{"operation":"list","target_sled":"c9f3bda2-4996-4bda-a233-772410078d0a","time":"2025-08-01T16:02:49.953808154Z"},{"generation":1,"operation":"put_config","target_sled":"c9f3bda2-4996-4bda-a233-772410078d0a","time":"2025-08-01T16:07:50.021207096Z"},{"operation":"list","target_sled":"c9f3bda2-4996-4bda-a233-772410078d0a","time":"2025-08-01T16:07:50.021494925Z"},{"generation":1,"operation":"put_config","target_sled":"c9f3bda2-4996-4bda-a233-772410078d0a","time":"2025-08-01T16:12:50.062657505Z"},{"operation":"list","target_sled":"c9f3bda2-4996-4bda-a233-772410078d0a","time":"2025-08-01T16:12:50.062892662Z"}]}
146182025-08-01T16:12:50.073ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
146192025-08-01T16:12:50.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
146202025-08-01T16:12:50.074ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146212025-08-01T16:12:50.079ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
146222025-08-01T16:12:50.079ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
146232025-08-01T16:12:50.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
146242025-08-01T16:12:50.080ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
146252025-08-01T16:12:50.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
146262025-08-01T16:12:50.082ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
146272025-08-01T16:12:50.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
146282025-08-01T16:12:50.084ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
146292025-08-01T16:12:50.084ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146302025-08-01T16:12:50.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
146312025-08-01T16:12:50.086ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 399.438252ms iteration = 31 status = null
146322025-08-01T16:12:50.088ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
146332025-08-01T16:12:50.088ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
146342025-08-01T16:12:50.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
146352025-08-01T16:12:50.094ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 04b363be-ccb0-479c-9061-146e0f3cd0f5, kind: Service { id: 47e81fb5-17f5-43c3-b06b-bf529b9c19c7 }, name: Name("nexus-47e81fb5-17f5-43c3-b06b-bf529b9c19c7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1a7b404e-03d2-462c-b83f-716d429c5ce6, kind: Service { id: 7248190d-c184-423c-8431-31fe40a79e2e }, name: Name("nexus-7248190d-c184-423c-8431-31fe40a79e2e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d893583b-243d-4d0f-855b-7369e8e9fbf2, kind: Service { id: 8dfddf96-9f2d-4f96-9bf8-8181bf947a28 }, name: Name("nexus-8dfddf96-9f2d-4f96-9bf8-8181bf947a28"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 228])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 674b1238-f8d3-485d-ac9a-18ae283a4c3f, kind: Service { id: d688a68d-d771-4ac5-8e66-9efa94dbbea8 }, name: Name("external-dns-d688a68d-d771-4ac5-8e66-9efa94dbbea8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 26])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 71946e26-41e0-47b5-a3f1-1dc1f88d6f19, kind: Service { id: cb706a84-a33b-442f-aac2-3a6eb5f3b330 }, name: Name("external-dns-cb706a84-a33b-442f-aac2-3a6eb5f3b330"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 140])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
146362025-08-01T16:12:50.094ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
146372025-08-01T16:12:50.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
146382025-08-01T16:12:50.096ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146392025-08-01T16:12:50.098ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
146402025-08-01T16:12:50.098ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
146412025-08-01T16:12:50.098ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
146422025-08-01T16:12:50.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
146432025-08-01T16:12:50.099ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
146442025-08-01T16:12:50.099ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 674b1238-f8d3-485d-ac9a-18ae283a4c3f, kind: Service { id: d688a68d-d771-4ac5-8e66-9efa94dbbea8 }, name: Name("external-dns-d688a68d-d771-4ac5-8e66-9efa94dbbea8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 26])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 71946e26-41e0-47b5-a3f1-1dc1f88d6f19, kind: Service { id: cb706a84-a33b-442f-aac2-3a6eb5f3b330 }, name: Name("external-dns-cb706a84-a33b-442f-aac2-3a6eb5f3b330"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 140])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 04b363be-ccb0-479c-9061-146e0f3cd0f5, kind: Service { id: 47e81fb5-17f5-43c3-b06b-bf529b9c19c7 }, name: Name("nexus-47e81fb5-17f5-43c3-b06b-bf529b9c19c7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1a7b404e-03d2-462c-b83f-716d429c5ce6, kind: Service { id: 7248190d-c184-423c-8431-31fe40a79e2e }, name: Name("nexus-7248190d-c184-423c-8431-31fe40a79e2e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d893583b-243d-4d0f-855b-7369e8e9fbf2, kind: Service { id: 8dfddf96-9f2d-4f96-9bf8-8181bf947a28 }, name: Name("nexus-8dfddf96-9f2d-4f96-9bf8-8181bf947a28"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 228])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 674b1238-f8d3-485d-ac9a-18ae283a4c3f, kind: Service { id: d688a68d-d771-4ac5-8e66-9efa94dbbea8 }, name: Name("external-dns-d688a68d-d771-4ac5-8e66-9efa94dbbea8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 26])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 71946e26-41e0-47b5-a3f1-1dc1f88d6f19, kind: Service { id: cb706a84-a33b-442f-aac2-3a6eb5f3b330 }, name: Name("external-dns-cb706a84-a33b-442f-aac2-3a6eb5f3b330"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 140])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 3, code: Some(IcmpParamRange { first: 3, last: 4 }) })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 5, code: None })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 11, code: None }))]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 04b363be-ccb0-479c-9061-146e0f3cd0f5, kind: Service { id: 47e81fb5-17f5-43c3-b06b-bf529b9c19c7 }, name: Name("nexus-47e81fb5-17f5-43c3-b06b-bf529b9c19c7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1a7b404e-03d2-462c-b83f-716d429c5ce6, kind: Service { id: 7248190d-c184-423c-8431-31fe40a79e2e }, name: Name("nexus-7248190d-c184-423c-8431-31fe40a79e2e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d893583b-243d-4d0f-855b-7369e8e9fbf2, kind: Service { id: 8dfddf96-9f2d-4f96-9bf8-8181bf947a28 }, name: Name("nexus-8dfddf96-9f2d-4f96-9bf8-8181bf947a28"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 228])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }]
146452025-08-01T16:12:50.099ZDEBGnexus (service-firewall-rule-progator): resolved 3 rules for sleds background_task = service_firewall_rule_propagation
146462025-08-01T16:12:50.119ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
146472025-08-01T16:12:50.119ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 410.123895ms iteration = 16 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
146482025-08-01T16:12:50.138ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
146492025-08-01T16:12:50.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
146502025-08-01T16:12:50.145ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146512025-08-01T16:12:50.147ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
146522025-08-01T16:12:50.147ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
146532025-08-01T16:12:50.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
146542025-08-01T16:12:50.149ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146552025-08-01T16:12:50.151ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
146562025-08-01T16:12:50.151ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
146572025-08-01T16:12:50.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
146582025-08-01T16:12:50.183ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 495.841505ms iteration = 31 status = {}
146592025-08-01T16:12:50.193ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
146602025-08-01T16:12:50.193ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "af74a54c-7180-498b-8cd7-79525aa8a8d6", "date": "Fri, 01 Aug 2025 16:12:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
146612025-08-01T16:12:50.193ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
146622025-08-01T16:12:50.195ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f18ffabb-b840-47e9-b0be-5b6f2e401b68", "date": "Fri, 01 Aug 2025 16:12:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
146632025-08-01T16:12:50.195ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
146642025-08-01T16:12:50.197ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
146652025-08-01T16:12:50.197ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 510.604212ms iteration = 18 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
146662025-08-01T16:12:50.239ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: c9f3bda2-4996-4bda-a233-772410078d0a, time_created: 2025-08-01T15:58:33.455031Z, time_modified: 2025-08-01T15:58:33.455031Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(56094621696)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
146672025-08-01T16:12:50.239ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
146682025-08-01T16:12:50.246ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
146692025-08-01T16:12:50.246ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
146702025-08-01T16:12:50.247ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
146712025-08-01T16:12:50.247ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "bf5e7024-34b0-49ae-846f-98f0a11d96de", "date": "Fri, 01 Aug 2025 16:12:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
146722025-08-01T16:12:50.247ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
146732025-08-01T16:12:50.249ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e1945df5-1f6f-4a09-a1c2-d484920a3210", "date": "Fri, 01 Aug 2025 16:12:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
146742025-08-01T16:12:50.249ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
146752025-08-01T16:12:50.251ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "60f1b770-7dac-49e8-8b04-e2de7a497f5f", "date": "Fri, 01 Aug 2025 16:12:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
146762025-08-01T16:12:50.251ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
146772025-08-01T16:12:50.253ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
146782025-08-01T16:12:50.253ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 566.528907ms iteration = 18 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
146792025-08-01T16:12:50.254ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "60aed80b-c274-4f57-a871-3313697f5180", "content-length": "372", "date": "Fri, 01 Aug 2025 16:12:50 GMT"} })
146802025-08-01T16:12:50.254ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
146812025-08-01T16:12:50.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
146822025-08-01T16:12:50.269ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
146832025-08-01T16:12:50.269ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
146842025-08-01T16:12:50.270ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9343851c-b906-4dde-98d2-6fceaed6b0fb", "date": "Fri, 01 Aug 2025 16:12:50 GMT"} })
146852025-08-01T16:12:50.270ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
146862025-08-01T16:12:50.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
146872025-08-01T16:12:50.272ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
146882025-08-01T16:12:50.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
146892025-08-01T16:12:50.276ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
146902025-08-01T16:12:50.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
146912025-08-01T16:12:50.278ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
146922025-08-01T16:12:50.278ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
146932025-08-01T16:12:50.279ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6acb7e93-ab50-4ffb-b1d6-dd53862c15c2", "date": "Fri, 01 Aug 2025 16:12:50 GMT"} })
146942025-08-01T16:12:50.281ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 522.648407ms iteration = 32 status = {}
146952025-08-01T16:12:50.283ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
146962025-08-01T16:12:50.285ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7497cee-2b17-4889-b9aa-391343dc59c7", "content-length": "691", "date": "Fri, 01 Aug 2025 16:12:50 GMT"} })
146972025-08-01T16:12:50.285ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
146982025-08-01T16:12:50.285ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
146992025-08-01T16:12:50.285ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
147002025-08-01T16:12:50.287ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 529.084513ms iteration = 32 status = {}
147012025-08-01T16:12:50.317ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
147022025-08-01T16:12:50.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
147032025-08-01T16:12:50.320ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
147042025-08-01T16:12:50.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
147052025-08-01T16:12:50.321ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147062025-08-01T16:12:50.324ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
147072025-08-01T16:12:50.324ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
147082025-08-01T16:12:50.326ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "90717a6f-adcc-41ac-83c8-a41ae2612d95", "date": "Fri, 01 Aug 2025 16:12:50 GMT"} })
147092025-08-01T16:12:50.328ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:491
147102025-08-01T16:12:50.328ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 618.936106ms
147112025-08-01T16:12:50.328ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 618.948378ms iteration = 4 status = {}
147122025-08-01T16:12:50.355ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
147132025-08-01T16:12:50.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
147142025-08-01T16:12:50.356ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 3f21d9d5-3adf-463a-a05d-bc2e2e5d64ca, rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(4c7da70d-ede0-4107-abc5-5650a053be38) } rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
147152025-08-01T16:12:50.356ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
147162025-08-01T16:12:50.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
147172025-08-01T16:12:50.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4075ff3f-ae5a-4cf7-94ab-7287938bd901 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147182025-08-01T16:12:50.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4075ff3f-ae5a-4cf7-94ab-7287938bd901 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147192025-08-01T16:12:50.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2248 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4075ff3f-ae5a-4cf7-94ab-7287938bd901 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147202025-08-01T16:12:50.370ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
147212025-08-01T16:12:50.370ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 4c7da70d-ede0-4107-abc5-5650a053be38
147222025-08-01T16:12:50.370ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
147232025-08-01T16:12:50.370ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
147242025-08-01T16:12:50.370ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
147252025-08-01T16:12:50.370ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
147262025-08-01T16:12:50.370ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
147272025-08-01T16:12:50.370ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
147282025-08-01T16:12:50.371ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
147292025-08-01T16:12:50.371ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
147302025-08-01T16:12:50.371ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
147312025-08-01T16:12:50.371ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
147322025-08-01T16:12:50.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
147332025-08-01T16:12:50.373ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
147342025-08-01T16:12:50.373ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
147352025-08-01T16:12:50.479ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "59468bb8-2176-449c-8aec-f4e16f2fe999", "date": "Fri, 01 Aug 2025 16:12:50 GMT"} })
147362025-08-01T16:12:50.480ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch = Switch0
147372025-08-01T16:12:50.480ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
147382025-08-01T16:12:50.480ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd2cabda-edcf-4ad5-b9f1-86a6f782774e", "content-length": "682", "date": "Fri, 01 Aug 2025 16:12:50 GMT"} })
147392025-08-01T16:12:50.480ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
147402025-08-01T16:12:50.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
147412025-08-01T16:12:50.484ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
147422025-08-01T16:12:50.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
147432025-08-01T16:12:50.487ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
147442025-08-01T16:12:50.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
147452025-08-01T16:12:50.489ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
147462025-08-01T16:12:50.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
147472025-08-01T16:12:50.497ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 739.070619ms iteration = 31 status = {}
147482025-08-01T16:12:51.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 869ea250-dc22-4997-8e79-1346c5f29eae roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147492025-08-01T16:12:51.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 869ea250-dc22-4997-8e79-1346c5f29eae resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147502025-08-01T16:12:51.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2439 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 869ea250-dc22-4997-8e79-1346c5f29eae response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147512025-08-01T16:12:52.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bb6e8b37-58dc-48da-aee1-9889ff6473fe roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147522025-08-01T16:12:52.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bb6e8b37-58dc-48da-aee1-9889ff6473fe resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147532025-08-01T16:12:52.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2606 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = bb6e8b37-58dc-48da-aee1-9889ff6473fe response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147542025-08-01T16:12:53.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0282f410-80b5-4ea1-a417-b9a7a091fdf3 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147552025-08-01T16:12:53.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0282f410-80b5-4ea1-a417-b9a7a091fdf3 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147562025-08-01T16:12:53.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2022 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0282f410-80b5-4ea1-a417-b9a7a091fdf3 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147572025-08-01T16:12:54.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b093c2f2-492f-49a1-a3bb-47dd0974d11e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147582025-08-01T16:12:54.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b093c2f2-492f-49a1-a3bb-47dd0974d11e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147592025-08-01T16:12:54.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2833 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b093c2f2-492f-49a1-a3bb-47dd0974d11e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147602025-08-01T16:12:54.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 182 reason = Timeout
147612025-08-01T16:12:54.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
147622025-08-01T16:12:54.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
147632025-08-01T16:12:54.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147642025-08-01T16:12:54.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
147652025-08-01T16:12:54.764ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
147662025-08-01T16:12:54.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
147672025-08-01T16:12:54.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
147682025-08-01T16:12:54.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.111426ms iteration = 182 status = {"chicken_switches_updated":false}
147692025-08-01T16:12:55.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7d0148e1-eea7-4b75-900f-fb6e7a1787fa roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147702025-08-01T16:12:55.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7d0148e1-eea7-4b75-900f-fb6e7a1787fa resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147712025-08-01T16:12:55.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2521 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7d0148e1-eea7-4b75-900f-fb6e7a1787fa response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147722025-08-01T16:12:56.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 24e0597d-f0ff-4a0c-a859-a14cd4d7cb77 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147732025-08-01T16:12:56.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 24e0597d-f0ff-4a0c-a859-a14cd4d7cb77 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147742025-08-01T16:12:56.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 4608 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 24e0597d-f0ff-4a0c-a859-a14cd4d7cb77 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147752025-08-01T16:12:57.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 00e3907c-5563-453b-a33c-d1107f527cf3 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147762025-08-01T16:12:57.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 00e3907c-5563-453b-a33c-d1107f527cf3 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147772025-08-01T16:12:57.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2415 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 00e3907c-5563-453b-a33c-d1107f527cf3 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147782025-08-01T16:12:58.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = acd206d2-4e68-4dd9-8898-71c45b6661c8 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147792025-08-01T16:12:58.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = acd206d2-4e68-4dd9-8898-71c45b6661c8 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147802025-08-01T16:12:58.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2781 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = acd206d2-4e68-4dd9-8898-71c45b6661c8 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147812025-08-01T16:12:59.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4e164fec-10e2-4c4c-8df4-cf382b4e3888 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147822025-08-01T16:12:59.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4e164fec-10e2-4c4c-8df4-cf382b4e3888 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147832025-08-01T16:12:59.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2384 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4e164fec-10e2-4c4c-8df4-cf382b4e3888 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
147842025-08-01T16:12:59.757ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 92 reason = Timeout
147852025-08-01T16:12:59.757ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
147862025-08-01T16:12:59.757ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 183 reason = Timeout
147872025-08-01T16:12:59.757ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
147882025-08-01T16:12:59.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
147892025-08-01T16:12:59.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
147902025-08-01T16:12:59.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 92 reason = Timeout
147912025-08-01T16:12:59.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
147922025-08-01T16:12:59.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
147932025-08-01T16:12:59.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147942025-08-01T16:12:59.761ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147952025-08-01T16:12:59.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
147962025-08-01T16:12:59.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
147972025-08-01T16:12:59.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
147982025-08-01T16:12:59.765ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
147992025-08-01T16:12:59.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
148002025-08-01T16:12:59.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
148012025-08-01T16:12:59.767ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
148022025-08-01T16:12:59.767ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 10.082876ms iteration = 183 status = {"chicken_switches_updated":false}
148032025-08-01T16:12:59.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
148042025-08-01T16:12:59.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
148052025-08-01T16:12:59.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148062025-08-01T16:12:59.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
148072025-08-01T16:12:59.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
148082025-08-01T16:12:59.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
148092025-08-01T16:12:59.791ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
148102025-08-01T16:12:59.791ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 31.754063ms iteration = 92 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
148112025-08-01T16:12:59.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
148122025-08-01T16:12:59.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
148132025-08-01T16:12:59.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 44.389926ms iteration = 92 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
148142025-08-01T16:12:59.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 870 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = d209b6cd-8169-46fd-ba43-6e2a2a29abf0 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
148152025-08-01T16:13:00.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c2f048c3-27df-4cc3-8c67-51a214c5889a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148162025-08-01T16:13:00.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c2f048c3-27df-4cc3-8c67-51a214c5889a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148172025-08-01T16:13:00.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2402 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c2f048c3-27df-4cc3-8c67-51a214c5889a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148182025-08-01T16:13:01.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 872e6481-4288-4580-aab5-39a74dd57a1f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148192025-08-01T16:13:01.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 872e6481-4288-4580-aab5-39a74dd57a1f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148202025-08-01T16:13:01.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2302 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 872e6481-4288-4580-aab5-39a74dd57a1f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148212025-08-01T16:13:02.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 152d9d08-153f-4df1-802b-ab0bdd7d9dde roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148222025-08-01T16:13:02.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 152d9d08-153f-4df1-802b-ab0bdd7d9dde resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148232025-08-01T16:13:02.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2790 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 152d9d08-153f-4df1-802b-ab0bdd7d9dde response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148242025-08-01T16:13:03.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0aa82b73-364f-4d00-a1eb-7aa28f6f6639 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148252025-08-01T16:13:03.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0aa82b73-364f-4d00-a1eb-7aa28f6f6639 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148262025-08-01T16:13:03.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1923 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 0aa82b73-364f-4d00-a1eb-7aa28f6f6639 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148272025-08-01T16:13:04.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 948cef58-2677-4e9d-8a25-b7002b9b7852 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148282025-08-01T16:13:04.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 948cef58-2677-4e9d-8a25-b7002b9b7852 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148292025-08-01T16:13:04.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2619 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 948cef58-2677-4e9d-8a25-b7002b9b7852 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148302025-08-01T16:13:04.757ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 184 reason = Timeout
148312025-08-01T16:13:04.757ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
148322025-08-01T16:13:04.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
148332025-08-01T16:13:04.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148342025-08-01T16:13:04.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
148352025-08-01T16:13:04.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
148362025-08-01T16:13:04.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
148372025-08-01T16:13:04.764ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
148382025-08-01T16:13:04.764ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.329162ms iteration = 184 status = {"chicken_switches_updated":false}
148392025-08-01T16:13:05.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1103fd19-8e70-40d6-aa10-5cf95e2f261c roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148402025-08-01T16:13:05.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1103fd19-8e70-40d6-aa10-5cf95e2f261c resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148412025-08-01T16:13:05.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2463 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1103fd19-8e70-40d6-aa10-5cf95e2f261c response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148422025-08-01T16:13:06.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2f052ab5-dd0b-42f0-8e9f-42a4200dae68 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148432025-08-01T16:13:06.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2f052ab5-dd0b-42f0-8e9f-42a4200dae68 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148442025-08-01T16:13:06.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2321 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2f052ab5-dd0b-42f0-8e9f-42a4200dae68 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148452025-08-01T16:13:07.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 93559d74-ddd9-419b-ab7e-d93489b0172e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148462025-08-01T16:13:07.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 93559d74-ddd9-419b-ab7e-d93489b0172e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148472025-08-01T16:13:07.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2038 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 93559d74-ddd9-419b-ab7e-d93489b0172e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148482025-08-01T16:13:08.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 74269fdc-778a-4205-bad0-f0bc9a3b5f65 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148492025-08-01T16:13:08.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 74269fdc-778a-4205-bad0-f0bc9a3b5f65 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148502025-08-01T16:13:08.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2758 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 74269fdc-778a-4205-bad0-f0bc9a3b5f65 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148512025-08-01T16:13:09.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 36e231bb-8afb-4ae7-8eb5-f8a39f831e32 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148522025-08-01T16:13:09.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 36e231bb-8afb-4ae7-8eb5-f8a39f831e32 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148532025-08-01T16:13:09.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2585 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 36e231bb-8afb-4ae7-8eb5-f8a39f831e32 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148542025-08-01T16:13:09.757ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 93 reason = Timeout
148552025-08-01T16:13:09.757ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 185 reason = Timeout
148562025-08-01T16:13:09.757ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
148572025-08-01T16:13:09.757ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
148582025-08-01T16:13:09.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
148592025-08-01T16:13:09.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
148602025-08-01T16:13:09.758ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 93 reason = Timeout
148612025-08-01T16:13:09.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
148622025-08-01T16:13:09.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
148632025-08-01T16:13:09.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148642025-08-01T16:13:09.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
148652025-08-01T16:13:09.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
148662025-08-01T16:13:09.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148672025-08-01T16:13:09.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
148682025-08-01T16:13:09.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
148692025-08-01T16:13:09.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
148702025-08-01T16:13:09.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
148712025-08-01T16:13:09.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
148722025-08-01T16:13:09.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
148732025-08-01T16:13:09.764ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
148742025-08-01T16:13:09.764ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.511678ms iteration = 185 status = {"chicken_switches_updated":false}
148752025-08-01T16:13:09.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
148762025-08-01T16:13:09.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
148772025-08-01T16:13:09.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148782025-08-01T16:13:09.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
148792025-08-01T16:13:09.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
148802025-08-01T16:13:09.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
148812025-08-01T16:13:09.784ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
148822025-08-01T16:13:09.784ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.637277ms iteration = 93 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
148832025-08-01T16:13:09.795ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.447516ms iteration = 93 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
148842025-08-01T16:13:09.919ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 700 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 630c3d8c-6903-4f6b-b66c-35fc3088173f response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
148852025-08-01T16:13:10.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9a3571c0-0b73-4e54-b124-bee66db7b34c roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148862025-08-01T16:13:10.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9a3571c0-0b73-4e54-b124-bee66db7b34c resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148872025-08-01T16:13:10.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2889 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9a3571c0-0b73-4e54-b124-bee66db7b34c response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148882025-08-01T16:13:11.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 67df66f0-6b6b-4ba0-a655-c0e579f1a33a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148892025-08-01T16:13:11.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 67df66f0-6b6b-4ba0-a655-c0e579f1a33a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148902025-08-01T16:13:11.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2300 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 67df66f0-6b6b-4ba0-a655-c0e579f1a33a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148912025-08-01T16:13:12.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1504646b-f99a-4b7f-ba5c-011406af5bee roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148922025-08-01T16:13:12.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1504646b-f99a-4b7f-ba5c-011406af5bee resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148932025-08-01T16:13:12.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2712 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1504646b-f99a-4b7f-ba5c-011406af5bee response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148942025-08-01T16:13:13.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c8ecd228-9a5b-4c9e-a7f3-53eac82cb148 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148952025-08-01T16:13:13.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c8ecd228-9a5b-4c9e-a7f3-53eac82cb148 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148962025-08-01T16:13:13.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1980 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c8ecd228-9a5b-4c9e-a7f3-53eac82cb148 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148972025-08-01T16:13:14.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 743af00a-c42f-4079-9b06-ddc1dc7e3c0e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148982025-08-01T16:13:14.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 743af00a-c42f-4079-9b06-ddc1dc7e3c0e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
148992025-08-01T16:13:14.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2206 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 743af00a-c42f-4079-9b06-ddc1dc7e3c0e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
149002025-08-01T16:13:14.757ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 186 reason = Timeout
149012025-08-01T16:13:14.757ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
149022025-08-01T16:13:14.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
149032025-08-01T16:13:14.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149042025-08-01T16:13:14.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
149052025-08-01T16:13:14.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
149062025-08-01T16:13:14.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
149072025-08-01T16:13:14.764ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
149082025-08-01T16:13:14.764ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.519798ms iteration = 186 status = {"chicken_switches_updated":false}
149092025-08-01T16:13:15.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 26651702-7f14-4ce7-9068-c45241034ffd roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
149102025-08-01T16:13:15.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 26651702-7f14-4ce7-9068-c45241034ffd resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
149112025-08-01T16:13:15.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2235 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 26651702-7f14-4ce7-9068-c45241034ffd response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
149122025-08-01T16:13:16.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6ad2e00c-c395-428f-b6be-aa929d825ad5 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
149132025-08-01T16:13:16.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6ad2e00c-c395-428f-b6be-aa929d825ad5 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
149142025-08-01T16:13:16.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2277 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6ad2e00c-c395-428f-b6be-aa929d825ad5 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
149152025-08-01T16:13:17.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5955505a-81da-4914-85c9-87cfa5a124a2 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
149162025-08-01T16:13:17.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5955505a-81da-4914-85c9-87cfa5a124a2 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
149172025-08-01T16:13:17.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2444 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5955505a-81da-4914-85c9-87cfa5a124a2 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
149182025-08-01T16:13:18.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 38e2c43f-1b4c-4c1a-9df3-92b9e63e85b3 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
149192025-08-01T16:13:18.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 38e2c43f-1b4c-4c1a-9df3-92b9e63e85b3 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
149202025-08-01T16:13:18.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2327 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 38e2c43f-1b4c-4c1a-9df3-92b9e63e85b3 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
149212025-08-01T16:13:19.686ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 32 reason = Timeout
149222025-08-01T16:13:19.686ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 32 reason = Timeout
149232025-08-01T16:13:19.686ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 32 reason = Timeout
149242025-08-01T16:13:19.686ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
149252025-08-01T16:13:19.686ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
149262025-08-01T16:13:19.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
149272025-08-01T16:13:19.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
149282025-08-01T16:13:19.689ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44495, tv_nsec: 707090293 } })
149292025-08-01T16:13:19.689ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44495, tv_nsec: 707146895 } })
149302025-08-01T16:13:19.690ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
149312025-08-01T16:13:19.690ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.741943ms iteration = 32 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
149322025-08-01T16:13:19.690ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
149332025-08-01T16:13:19.752ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
149342025-08-01T16:13:19.752ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
149352025-08-01T16:13:19.752ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
149362025-08-01T16:13:19.752ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
149372025-08-01T16:13:19.753ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ddd61d4a-5623-4f86-9a97-e71a40a36dfd", "content-length": "26", "date": "Fri, 01 Aug 2025 16:13:19 GMT"} })
149382025-08-01T16:13:19.753ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
149392025-08-01T16:13:19.753ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b11dd2d9-d97d-4e21-b187-a8967fed3a38", "content-length": "26", "date": "Fri, 01 Aug 2025 16:13:19 GMT"} })
149402025-08-01T16:13:19.753ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
149412025-08-01T16:13:19.754ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
149422025-08-01T16:13:19.755ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
149432025-08-01T16:13:19.757ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 32 reason = Timeout
149442025-08-01T16:13:19.757ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 32 reason = Timeout
149452025-08-01T16:13:19.757ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 13.881\u{b5}s iteration = 32 status = {"disabled":true,"errors":[],"sps":[]}
149462025-08-01T16:13:19.757ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 32 reason = Timeout
149472025-08-01T16:13:19.757ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
149482025-08-01T16:13:19.757ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 33 reason = Timeout
149492025-08-01T16:13:19.757ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
149502025-08-01T16:13:19.757ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
149512025-08-01T16:13:19.757ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 94 reason = Timeout
149522025-08-01T16:13:19.757ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
149532025-08-01T16:13:19.757ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 187 reason = Timeout
149542025-08-01T16:13:19.757ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 33 reason = Timeout
149552025-08-01T16:13:19.757ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
149562025-08-01T16:13:19.757ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
149572025-08-01T16:13:19.757ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
149582025-08-01T16:13:19.757ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 32 reason = Timeout
149592025-08-01T16:13:19.757ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 32 reason = Timeout
149602025-08-01T16:13:19.757ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
149612025-08-01T16:13:19.757ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
149622025-08-01T16:13:19.757ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 32 reason = Timeout
149632025-08-01T16:13:19.757ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
149642025-08-01T16:13:19.757ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 32 reason = Timeout
149652025-08-01T16:13:19.757ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
149662025-08-01T16:13:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 32 reason = Timeout
149672025-08-01T16:13:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
149682025-08-01T16:13:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 32 reason = Timeout
149692025-08-01T16:13:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
149702025-08-01T16:13:19.758ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 35 reason = Timeout
149712025-08-01T16:13:19.758ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
149722025-08-01T16:13:19.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 32 reason = Timeout
149732025-08-01T16:13:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
149742025-08-01T16:13:19.758ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 33 reason = Timeout
149752025-08-01T16:13:19.758ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
149762025-08-01T16:13:19.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
149772025-08-01T16:13:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
149782025-08-01T16:13:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
149792025-08-01T16:13:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
149802025-08-01T16:13:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
149812025-08-01T16:13:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
149822025-08-01T16:13:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
149832025-08-01T16:13:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
149842025-08-01T16:13:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
149852025-08-01T16:13:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
149862025-08-01T16:13:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
149872025-08-01T16:13:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
149882025-08-01T16:13:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
149892025-08-01T16:13:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
149902025-08-01T16:13:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
149912025-08-01T16:13:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
149922025-08-01T16:13:19.759ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 32 reason = Timeout
149932025-08-01T16:13:19.759ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 94 reason = Timeout
149942025-08-01T16:13:19.759ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
149952025-08-01T16:13:19.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
149962025-08-01T16:13:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
149972025-08-01T16:13:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
149982025-08-01T16:13:19.759ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149992025-08-01T16:13:19.760ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150002025-08-01T16:13:19.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150012025-08-01T16:13:19.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
150022025-08-01T16:13:19.763ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
150032025-08-01T16:13:19.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
150042025-08-01T16:13:19.763ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150052025-08-01T16:13:19.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
150062025-08-01T16:13:19.763ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
150072025-08-01T16:13:19.763ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150082025-08-01T16:13:19.763ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150092025-08-01T16:13:19.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
150102025-08-01T16:13:19.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
150112025-08-01T16:13:19.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
150122025-08-01T16:13:19.765ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
150132025-08-01T16:13:19.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
150142025-08-01T16:13:19.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
150152025-08-01T16:13:19.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150162025-08-01T16:13:19.765ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150172025-08-01T16:13:19.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
150182025-08-01T16:13:19.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
150192025-08-01T16:13:19.768ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
150202025-08-01T16:13:19.768ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
150212025-08-01T16:13:19.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
150222025-08-01T16:13:19.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
150232025-08-01T16:13:19.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
150242025-08-01T16:13:19.769ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
150252025-08-01T16:13:19.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
150262025-08-01T16:13:19.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
150272025-08-01T16:13:19.770ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
150282025-08-01T16:13:19.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
150292025-08-01T16:13:19.771ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
150302025-08-01T16:13:19.771ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 14.095938ms iteration = 187 status = {"chicken_switches_updated":false}
150312025-08-01T16:13:19.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
150322025-08-01T16:13:19.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
150332025-08-01T16:13:19.772ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150342025-08-01T16:13:19.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
150352025-08-01T16:13:19.772ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
150362025-08-01T16:13:19.772ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44495, tv_nsec: 790075439 } })
150372025-08-01T16:13:19.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
150382025-08-01T16:13:19.773ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
150392025-08-01T16:13:19.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
150402025-08-01T16:13:19.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
150412025-08-01T16:13:19.775ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
150422025-08-01T16:13:19.775ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
150432025-08-01T16:13:19.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
150442025-08-01T16:13:19.777ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
150452025-08-01T16:13:19.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
150462025-08-01T16:13:19.816ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
150472025-08-01T16:13:19.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
150482025-08-01T16:13:19.817ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 59.228707ms iteration = 32 status = {"errors":[],"finish_invoked_ok":[]}
150492025-08-01T16:13:19.817ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
150502025-08-01T16:13:19.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
150512025-08-01T16:13:19.818ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.066952ms iteration = 32 status = {"errors":[],"garbage_collect_requested":[]}
150522025-08-01T16:13:19.820ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.67156ms iteration = 94 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
150532025-08-01T16:13:19.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8d23f1e2-3909-4454-b052-70b5e20e3d5b roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
150542025-08-01T16:13:19.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8d23f1e2-3909-4454-b052-70b5e20e3d5b resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
150552025-08-01T16:13:19.828ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 70.688083ms iteration = 32 status = {"errors":[],"requests_created_ok":[]}
150562025-08-01T16:13:19.829ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 71.650572ms iteration = 32 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
150572025-08-01T16:13:19.829ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
150582025-08-01T16:13:19.829ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 71.57996ms iteration = 32 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
150592025-08-01T16:13:19.830ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
150602025-08-01T16:13:19.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 4376 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 8d23f1e2-3909-4454-b052-70b5e20e3d5b response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
150612025-08-01T16:13:19.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
150622025-08-01T16:13:19.835ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
150632025-08-01T16:13:19.835ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150642025-08-01T16:13:19.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
150652025-08-01T16:13:19.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
150662025-08-01T16:13:19.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
150672025-08-01T16:13:19.840ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150682025-08-01T16:13:19.840ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
150692025-08-01T16:13:19.840ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
150702025-08-01T16:13:19.840ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
150712025-08-01T16:13:19.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
150722025-08-01T16:13:19.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
150732025-08-01T16:13:19.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
150742025-08-01T16:13:19.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
150752025-08-01T16:13:19.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
150762025-08-01T16:13:19.843ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
150772025-08-01T16:13:19.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
150782025-08-01T16:13:19.844ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 86.760781ms iteration = 32 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
150792025-08-01T16:13:19.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
150802025-08-01T16:13:19.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
150812025-08-01T16:13:19.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
150822025-08-01T16:13:19.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
150832025-08-01T16:13:19.853ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150842025-08-01T16:13:19.854ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150852025-08-01T16:13:19.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
150862025-08-01T16:13:19.857ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
150872025-08-01T16:13:19.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
150882025-08-01T16:13:19.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
150892025-08-01T16:13:19.858ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
150902025-08-01T16:13:19.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
150912025-08-01T16:13:19.859ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 101.903959ms iteration = 32 status = 0
150922025-08-01T16:13:19.864ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
150932025-08-01T16:13:19.864ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 105.51319ms iteration = 94 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
150942025-08-01T16:13:19.885ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
150952025-08-01T16:13:19.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
150962025-08-01T16:13:19.889ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 202.257363ms iteration = 32 status = {}
150972025-08-01T16:13:19.893ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
150982025-08-01T16:13:19.893ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
150992025-08-01T16:13:19.893ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
151002025-08-01T16:13:19.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
151012025-08-01T16:13:19.896ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:391
151022025-08-01T16:13:19.896ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 137.021855ms iteration = 32 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
151032025-08-01T16:13:19.896ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
151042025-08-01T16:13:19.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
151052025-08-01T16:13:19.899ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 212.265087ms iteration = 32 status = null
151062025-08-01T16:13:19.919ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 616 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = 4678e148-177d-4879-8e91-79a443427df6 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
151072025-08-01T16:13:19.931ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 173.236202ms iteration = 32 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
151082025-08-01T16:13:19.942ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
151092025-08-01T16:13:19.942ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
151102025-08-01T16:13:19.942ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 185.110533ms iteration = 33 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
151112025-08-01T16:13:19.950ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 zone_address = fd00:1122:3344:101::2
151122025-08-01T16:13:19.950ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
151132025-08-01T16:13:19.951ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ec3877f-9468-451a-9ed9-cade47e107a5", "content-length": "26", "date": "Fri, 01 Aug 2025 16:13:19 GMT"} })
151142025-08-01T16:13:19.951ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
151152025-08-01T16:13:19.953ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
151162025-08-01T16:13:19.959ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
151172025-08-01T16:13:19.959ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
151182025-08-01T16:13:19.959ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e0d6647-c2a5-4e3f-b580-7ed641a406ca", "content-length": "372", "date": "Fri, 01 Aug 2025 16:13:19 GMT"} })
151192025-08-01T16:13:19.959ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
151202025-08-01T16:13:19.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
151212025-08-01T16:13:19.987ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
151222025-08-01T16:13:19.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
151232025-08-01T16:13:19.989ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
151242025-08-01T16:13:19.991ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
151252025-08-01T16:13:19.991ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
151262025-08-01T16:13:19.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
151272025-08-01T16:13:19.993ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
151282025-08-01T16:13:19.994ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 236.863212ms iteration = 35 status = {"physical_disks_added":0}
151292025-08-01T16:13:19.997ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
151302025-08-01T16:13:19.997ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
151312025-08-01T16:13:19.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
151322025-08-01T16:13:20.015ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
151332025-08-01T16:13:20.015ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
151342025-08-01T16:13:20.015ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4636ec90-2cf2-4a9f-8b54-462900c5a6f9", "date": "Fri, 01 Aug 2025 16:13:19 GMT"} })
151352025-08-01T16:13:20.015ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
151362025-08-01T16:13:20.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
151372025-08-01T16:13:20.018ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
151382025-08-01T16:13:20.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
151392025-08-01T16:13:20.021ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
151402025-08-01T16:13:20.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
151412025-08-01T16:13:20.023ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
151422025-08-01T16:13:20.023ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
151432025-08-01T16:13:20.024ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0443e650-a988-40a1-a6a6-f2ac59ff7602", "date": "Fri, 01 Aug 2025 16:13:19 GMT"} })
151442025-08-01T16:13:20.026ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 268.668306ms iteration = 33 status = {}
151452025-08-01T16:13:20.053ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
151462025-08-01T16:13:20.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
151472025-08-01T16:13:20.055ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 3f21d9d5-3adf-463a-a05d-bc2e2e5d64ca, rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(4c7da70d-ede0-4107-abc5-5650a053be38) } rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
151482025-08-01T16:13:20.055ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
151492025-08-01T16:13:20.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
151502025-08-01T16:13:20.066ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
151512025-08-01T16:13:20.066ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 4c7da70d-ede0-4107-abc5-5650a053be38
151522025-08-01T16:13:20.066ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
151532025-08-01T16:13:20.066ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
151542025-08-01T16:13:20.066ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
151552025-08-01T16:13:20.066ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
151562025-08-01T16:13:20.066ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
151572025-08-01T16:13:20.066ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
151582025-08-01T16:13:20.066ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
151592025-08-01T16:13:20.066ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
151602025-08-01T16:13:20.067ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
151612025-08-01T16:13:20.067ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
151622025-08-01T16:13:20.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
151632025-08-01T16:13:20.069ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
151642025-08-01T16:13:20.069ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
151652025-08-01T16:13:20.098ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
151662025-08-01T16:13:20.099ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1760582-705d-4fd1-8ff6-ea00eae5d2a3", "content-length": "691", "date": "Fri, 01 Aug 2025 16:13:19 GMT"} })
151672025-08-01T16:13:20.099ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
151682025-08-01T16:13:20.099ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
151692025-08-01T16:13:20.099ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
151702025-08-01T16:13:20.100ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 342.563727ms iteration = 33 status = {}
151712025-08-01T16:13:20.177ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5c8881d1-8828-45d3-946e-951659479aed", "date": "Fri, 01 Aug 2025 16:13:19 GMT"} })
151722025-08-01T16:13:20.177ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch = Switch0
151732025-08-01T16:13:20.177ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
151742025-08-01T16:13:20.184ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "eaa0095d-f811-4ef2-974b-c4b8e893ceda", "content-length": "682", "date": "Fri, 01 Aug 2025 16:13:20 GMT"} })
151752025-08-01T16:13:20.184ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
151762025-08-01T16:13:20.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
151772025-08-01T16:13:20.188ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
151782025-08-01T16:13:20.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
151792025-08-01T16:13:20.192ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
151802025-08-01T16:13:20.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
151812025-08-01T16:13:20.194ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
151822025-08-01T16:13:20.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
151832025-08-01T16:13:20.201ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 444.103756ms iteration = 32 status = {}
151842025-08-01T16:13:20.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b1cefc08-b8f6-4397-b75d-afb3b716d3b2 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
151852025-08-01T16:13:20.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b1cefc08-b8f6-4397-b75d-afb3b716d3b2 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
151862025-08-01T16:13:20.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2246 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b1cefc08-b8f6-4397-b75d-afb3b716d3b2 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
151872025-08-01T16:13:21.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cc5dc7a4-cffe-499f-97ad-6b57e6744757 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
151882025-08-01T16:13:21.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cc5dc7a4-cffe-499f-97ad-6b57e6744757 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
151892025-08-01T16:13:21.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2551 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = cc5dc7a4-cffe-499f-97ad-6b57e6744757 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
151902025-08-01T16:13:22.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5ecfeb21-852e-4e05-bd5a-3702d38e135a roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
151912025-08-01T16:13:22.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5ecfeb21-852e-4e05-bd5a-3702d38e135a resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
151922025-08-01T16:13:22.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2319 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 5ecfeb21-852e-4e05-bd5a-3702d38e135a response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
151932025-08-01T16:13:23.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 19384db2-4383-4e62-9fde-57dfad3d7adf roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
151942025-08-01T16:13:23.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 19384db2-4383-4e62-9fde-57dfad3d7adf resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
151952025-08-01T16:13:23.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2735 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 19384db2-4383-4e62-9fde-57dfad3d7adf response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
151962025-08-01T16:13:24.757ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 188 reason = Timeout
151972025-08-01T16:13:24.757ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
151982025-08-01T16:13:24.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
151992025-08-01T16:13:24.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152002025-08-01T16:13:24.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
152012025-08-01T16:13:24.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
152022025-08-01T16:13:24.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
152032025-08-01T16:13:24.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
152042025-08-01T16:13:24.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.26024ms iteration = 188 status = {"chicken_switches_updated":false}
152052025-08-01T16:13:24.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1b4f0370-6e69-4a79-b96c-4153af7e1621 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152062025-08-01T16:13:24.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1b4f0370-6e69-4a79-b96c-4153af7e1621 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152072025-08-01T16:13:24.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2549 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 1b4f0370-6e69-4a79-b96c-4153af7e1621 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152082025-08-01T16:13:25.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = accea43e-f4b6-4d4f-b215-25a58817fa2d roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152092025-08-01T16:13:25.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = accea43e-f4b6-4d4f-b215-25a58817fa2d resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152102025-08-01T16:13:25.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2310 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = accea43e-f4b6-4d4f-b215-25a58817fa2d response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152112025-08-01T16:13:26.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3394db00-266b-4561-acf3-c4196ce4fec9 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152122025-08-01T16:13:26.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3394db00-266b-4561-acf3-c4196ce4fec9 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152132025-08-01T16:13:26.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2350 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3394db00-266b-4561-acf3-c4196ce4fec9 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152142025-08-01T16:13:27.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 59e66503-8253-4438-b985-4d2d965a007f roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152152025-08-01T16:13:27.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 59e66503-8253-4438-b985-4d2d965a007f resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152162025-08-01T16:13:27.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2844 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 59e66503-8253-4438-b985-4d2d965a007f response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152172025-08-01T16:13:28.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d371d834-7817-400d-8cc6-a46ffffaa0dc roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152182025-08-01T16:13:28.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d371d834-7817-400d-8cc6-a46ffffaa0dc resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152192025-08-01T16:13:28.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2693 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d371d834-7817-400d-8cc6-a46ffffaa0dc response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152202025-08-01T16:13:29.757ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 95 reason = Timeout
152212025-08-01T16:13:29.757ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 189 reason = Timeout
152222025-08-01T16:13:29.757ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
152232025-08-01T16:13:29.757ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
152242025-08-01T16:13:29.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
152252025-08-01T16:13:29.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
152262025-08-01T16:13:29.758ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 95 reason = Timeout
152272025-08-01T16:13:29.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
152282025-08-01T16:13:29.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
152292025-08-01T16:13:29.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152302025-08-01T16:13:29.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
152312025-08-01T16:13:29.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
152322025-08-01T16:13:29.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
152332025-08-01T16:13:29.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
152342025-08-01T16:13:29.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
152352025-08-01T16:13:29.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
152362025-08-01T16:13:29.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.846948ms iteration = 189 status = {"chicken_switches_updated":false}
152372025-08-01T16:13:29.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152382025-08-01T16:13:29.795ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.082934ms iteration = 95 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
152392025-08-01T16:13:29.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
152402025-08-01T16:13:29.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
152412025-08-01T16:13:29.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
152422025-08-01T16:13:29.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
152432025-08-01T16:13:29.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
152442025-08-01T16:13:29.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152452025-08-01T16:13:29.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
152462025-08-01T16:13:29.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
152472025-08-01T16:13:29.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
152482025-08-01T16:13:29.821ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
152492025-08-01T16:13:29.821ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 62.255887ms iteration = 95 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
152502025-08-01T16:13:29.919ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 577 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = d6ba15d9-4d1d-4d70-9ead-42c3a7138199 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
152512025-08-01T16:13:29.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 51241e84-df23-4eea-ad53-5ede08582e54 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152522025-08-01T16:13:29.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 51241e84-df23-4eea-ad53-5ede08582e54 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152532025-08-01T16:13:29.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2039 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 51241e84-df23-4eea-ad53-5ede08582e54 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152542025-08-01T16:13:31.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6c61bb39-6140-4128-b17f-7dd0b64bba45 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152552025-08-01T16:13:31.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6c61bb39-6140-4128-b17f-7dd0b64bba45 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152562025-08-01T16:13:31.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2120 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 6c61bb39-6140-4128-b17f-7dd0b64bba45 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152572025-08-01T16:13:32.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3609b382-1019-4044-9ad7-98cf8ac779c5 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152582025-08-01T16:13:32.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3609b382-1019-4044-9ad7-98cf8ac779c5 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152592025-08-01T16:13:32.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2115 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3609b382-1019-4044-9ad7-98cf8ac779c5 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152602025-08-01T16:13:33.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2674058e-1e93-4e0d-935d-11cfe2dc9bc7 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152612025-08-01T16:13:33.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2674058e-1e93-4e0d-935d-11cfe2dc9bc7 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152622025-08-01T16:13:33.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2031 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 2674058e-1e93-4e0d-935d-11cfe2dc9bc7 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152632025-08-01T16:13:34.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f60d0741-ae0c-4ad4-b1e9-2daf924af3b9 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152642025-08-01T16:13:34.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f60d0741-ae0c-4ad4-b1e9-2daf924af3b9 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152652025-08-01T16:13:34.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2652 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = f60d0741-ae0c-4ad4-b1e9-2daf924af3b9 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152662025-08-01T16:13:34.757ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 190 reason = Timeout
152672025-08-01T16:13:34.757ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
152682025-08-01T16:13:34.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
152692025-08-01T16:13:34.759ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152702025-08-01T16:13:34.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
152712025-08-01T16:13:34.762ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
152722025-08-01T16:13:34.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
152732025-08-01T16:13:34.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
152742025-08-01T16:13:34.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.58757ms iteration = 190 status = {"chicken_switches_updated":false}
152752025-08-01T16:13:35.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 16a582f0-54b0-4703-8ffe-19a9d77eee00 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152762025-08-01T16:13:35.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 16a582f0-54b0-4703-8ffe-19a9d77eee00 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152772025-08-01T16:13:35.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2406 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 16a582f0-54b0-4703-8ffe-19a9d77eee00 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152782025-08-01T16:13:36.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9f8d2973-8ac7-455f-b54e-6a77f89753c7 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152792025-08-01T16:13:36.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9f8d2973-8ac7-455f-b54e-6a77f89753c7 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152802025-08-01T16:13:36.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2471 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9f8d2973-8ac7-455f-b54e-6a77f89753c7 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152812025-08-01T16:13:37.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 339a8692-296a-4f1f-bf4e-0c5d3c01e074 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152822025-08-01T16:13:37.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 339a8692-296a-4f1f-bf4e-0c5d3c01e074 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152832025-08-01T16:13:37.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2236 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 339a8692-296a-4f1f-bf4e-0c5d3c01e074 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152842025-08-01T16:13:38.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 74720d58-e80a-4dc5-a6fb-ff0655baccc2 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152852025-08-01T16:13:38.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 74720d58-e80a-4dc5-a6fb-ff0655baccc2 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152862025-08-01T16:13:38.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2566 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 74720d58-e80a-4dc5-a6fb-ff0655baccc2 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152872025-08-01T16:13:39.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 67ce4198-9895-42a6-b478-e932c0fbe795 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152882025-08-01T16:13:39.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 67ce4198-9895-42a6-b478-e932c0fbe795 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152892025-08-01T16:13:39.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2172 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 67ce4198-9895-42a6-b478-e932c0fbe795 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
152902025-08-01T16:13:39.757ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 96 reason = Timeout
152912025-08-01T16:13:39.757ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 191 reason = Timeout
152922025-08-01T16:13:39.757ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
152932025-08-01T16:13:39.757ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
152942025-08-01T16:13:39.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
152952025-08-01T16:13:39.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
152962025-08-01T16:13:39.758ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 96 reason = Timeout
152972025-08-01T16:13:39.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
152982025-08-01T16:13:39.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
152992025-08-01T16:13:39.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
153002025-08-01T16:13:39.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
153012025-08-01T16:13:39.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
153022025-08-01T16:13:39.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
153032025-08-01T16:13:39.762ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.441705ms iteration = 96 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
153042025-08-01T16:13:39.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
153052025-08-01T16:13:39.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
153062025-08-01T16:13:39.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
153072025-08-01T16:13:39.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
153082025-08-01T16:13:39.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
153092025-08-01T16:13:39.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
153102025-08-01T16:13:39.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
153112025-08-01T16:13:39.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.555879ms iteration = 191 status = {"chicken_switches_updated":false}
153122025-08-01T16:13:39.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
153132025-08-01T16:13:39.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
153142025-08-01T16:13:39.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
153152025-08-01T16:13:39.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
153162025-08-01T16:13:39.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
153172025-08-01T16:13:39.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
153182025-08-01T16:13:39.787ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
153192025-08-01T16:13:39.787ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.734701ms iteration = 96 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
153202025-08-01T16:13:39.919ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 668 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = c4df9260-ec84-4fbb-95e7-ef17a623c5d9 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
153212025-08-01T16:13:40.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 52baa7d5-f734-4e2d-9fb3-fbf94d042557 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153222025-08-01T16:13:40.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 52baa7d5-f734-4e2d-9fb3-fbf94d042557 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153232025-08-01T16:13:40.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2641 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 52baa7d5-f734-4e2d-9fb3-fbf94d042557 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153242025-08-01T16:13:41.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7b3ec4d8-0449-451f-891e-d3ddf982a243 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153252025-08-01T16:13:41.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7b3ec4d8-0449-451f-891e-d3ddf982a243 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153262025-08-01T16:13:41.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2104 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 7b3ec4d8-0449-451f-891e-d3ddf982a243 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153272025-08-01T16:13:42.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ad76cc1b-d96b-479c-92d9-28cacb38b27b roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153282025-08-01T16:13:42.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ad76cc1b-d96b-479c-92d9-28cacb38b27b resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153292025-08-01T16:13:42.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2278 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = ad76cc1b-d96b-479c-92d9-28cacb38b27b response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153302025-08-01T16:13:43.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3686aafa-6336-412f-8447-0b42b66a2f78 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153312025-08-01T16:13:43.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3686aafa-6336-412f-8447-0b42b66a2f78 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153322025-08-01T16:13:43.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2323 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 3686aafa-6336-412f-8447-0b42b66a2f78 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153332025-08-01T16:13:44.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4ddbc6ab-fbbc-486b-af01-a8a245b0e354 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153342025-08-01T16:13:44.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4ddbc6ab-fbbc-486b-af01-a8a245b0e354 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153352025-08-01T16:13:44.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2519 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 4ddbc6ab-fbbc-486b-af01-a8a245b0e354 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153362025-08-01T16:13:44.757ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 192 reason = Timeout
153372025-08-01T16:13:44.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
153382025-08-01T16:13:44.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
153392025-08-01T16:13:44.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
153402025-08-01T16:13:44.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
153412025-08-01T16:13:44.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
153422025-08-01T16:13:44.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
153432025-08-01T16:13:44.765ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
153442025-08-01T16:13:44.765ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.389584ms iteration = 192 status = {"chicken_switches_updated":false}
153452025-08-01T16:13:44.912ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::d]:33136
153462025-08-01T16:13:44.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33136 req_id = 406bf3e6-7a46-4b3b-a694-fe1db760f7d2 roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
153472025-08-01T16:13:44.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33136 req_id = 406bf3e6-7a46-4b3b-a694-fe1db760f7d2 resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
153482025-08-01T16:13:44.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3066 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33136 req_id = 406bf3e6-7a46-4b3b-a694-fe1db760f7d2 response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?sort_by=id_ascending
153492025-08-01T16:13:44.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33136 req_id = ffa3cd41-9909-4617-ad1c-e97469154c74 roles = RoleSet { roles: {} } uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
153502025-08-01T16:13:44.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33136 req_id = ffa3cd41-9909-4617-ad1c-e97469154c74 resource = Database result = Ok(()) uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
153512025-08-01T16:13:44.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2607 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33136 req_id = ffa3cd41-9909-4617-ad1c-e97469154c74 response_code = 200 uri = /metrics/collectors/7bf2727d-8ae8-417c-81cf-59aa0ad1690b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWYzYmRhMi00OTk2LTRiZGEtYTIzMy03NzI0MTAwNzhkMGEifX0%3D
153522025-08-01T16:13:45.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 757972a3-3113-4271-b4f2-52b5f7d1a339 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153532025-08-01T16:13:45.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 757972a3-3113-4271-b4f2-52b5f7d1a339 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153542025-08-01T16:13:45.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2713 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 757972a3-3113-4271-b4f2-52b5f7d1a339 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153552025-08-01T16:13:46.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 65697426-d912-41f7-ab94-8b910a726772 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153562025-08-01T16:13:46.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 65697426-d912-41f7-ab94-8b910a726772 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153572025-08-01T16:13:46.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2138 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 65697426-d912-41f7-ab94-8b910a726772 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153582025-08-01T16:13:47.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 58ff39f0-8b48-4eab-bce3-cbd0c544a1b2 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153592025-08-01T16:13:47.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 58ff39f0-8b48-4eab-bce3-cbd0c544a1b2 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153602025-08-01T16:13:47.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2368 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 58ff39f0-8b48-4eab-bce3-cbd0c544a1b2 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153612025-08-01T16:13:48.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d2496192-b480-4d9d-b9b6-9f4c3bf85ad0 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153622025-08-01T16:13:48.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d2496192-b480-4d9d-b9b6-9f4c3bf85ad0 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153632025-08-01T16:13:48.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2685 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = d2496192-b480-4d9d-b9b6-9f4c3bf85ad0 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153642025-08-01T16:13:49.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c6bd5bff-b6a6-47a2-9543-f837afd4854e roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153652025-08-01T16:13:49.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c6bd5bff-b6a6-47a2-9543-f837afd4854e resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153662025-08-01T16:13:49.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3009 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = c6bd5bff-b6a6-47a2-9543-f837afd4854e response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
153672025-08-01T16:13:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 17 reason = Timeout
153682025-08-01T16:13:49.687ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 17 reason = Timeout
153692025-08-01T16:13:49.687ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 33 reason = Timeout
153702025-08-01T16:13:49.687ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
153712025-08-01T16:13:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 19 reason = Timeout
153722025-08-01T16:13:49.687ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 17 reason = Timeout
153732025-08-01T16:13:49.687ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-01 16:03:49.687392700 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
153742025-08-01T16:13:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 17 reason = Timeout
153752025-08-01T16:13:49.687ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
153762025-08-01T16:13:49.687ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
153772025-08-01T16:13:49.687ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 33 reason = Timeout
153782025-08-01T16:13:49.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
153792025-08-01T16:13:49.687ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
153802025-08-01T16:13:49.687ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 33 reason = Timeout
153812025-08-01T16:13:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 19 reason = Timeout
153822025-08-01T16:13:49.687ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
153832025-08-01T16:13:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 17 reason = Timeout
153842025-08-01T16:13:49.687ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
153852025-08-01T16:13:49.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
153862025-08-01T16:13:49.687ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 17 reason = Timeout
153872025-08-01T16:13:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
153882025-08-01T16:13:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
153892025-08-01T16:13:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
153902025-08-01T16:13:49.687ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50fe31de-3241-42df-a386-de37ce323a34.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("58598327-8751-423c-a5ac-c610829651e2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a80ba1c9-daa5-4fa8-a6fb-a796ebfc55f0.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 44525, tv_nsec: 705158418 } })
153912025-08-01T16:13:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
153922025-08-01T16:13:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
153932025-08-01T16:13:49.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
153942025-08-01T16:13:49.687ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cb706a84-a33b-442f-aac2-3a6eb5f3b330.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d688a68d-d771-4ac5-8e66-9efa94dbbea8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d688a68d-d771-4ac5-8e66-9efa94dbbea8.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 44525, tv_nsec: 705239081 } })
153952025-08-01T16:13:49.688ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
153962025-08-01T16:13:49.688ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 881.067\u{b5}s iteration = 17 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
153972025-08-01T16:13:49.688ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
153982025-08-01T16:13:49.688ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.058242ms iteration = 17 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
153992025-08-01T16:13:49.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
154002025-08-01T16:13:49.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
154012025-08-01T16:13:49.689ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
154022025-08-01T16:13:49.690ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
154032025-08-01T16:13:49.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
154042025-08-01T16:13:49.690ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44525, tv_nsec: 708197610 } })
154052025-08-01T16:13:49.691ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44525, tv_nsec: 708453768 } })
154062025-08-01T16:13:49.691ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
154072025-08-01T16:13:49.691ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
154082025-08-01T16:13:49.691ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
154092025-08-01T16:13:49.691ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
154102025-08-01T16:13:49.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
154112025-08-01T16:13:49.692ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.656781ms iteration = 33 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
154122025-08-01T16:13:49.692ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
154132025-08-01T16:13:49.692ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-01 16:03:49.687392700 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
154142025-08-01T16:13:49.692ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.023803ms iteration = 17 status = {"expiration":"2025-08-01T16:03:49.687392700Z","pruned":[]}
154152025-08-01T16:13:49.692ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
154162025-08-01T16:13:49.694ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
154172025-08-01T16:13:49.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
154182025-08-01T16:13:49.696ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
154192025-08-01T16:13:49.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
154202025-08-01T16:13:49.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
154212025-08-01T16:13:49.701ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
154222025-08-01T16:13:49.701ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
154232025-08-01T16:13:49.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
154242025-08-01T16:13:49.706ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 18 reason = Timeout
154252025-08-01T16:13:49.706ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1
154262025-08-01T16:13:49.706ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 27.411\u{b5}s iteration = 18 status = {"enabled":false,"target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1"}
154272025-08-01T16:13:49.708ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 21 reason = Timeout
154282025-08-01T16:13:49.708ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
154292025-08-01T16:13:49.708ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 16.67\u{b5}s iteration = 21 status = "Disabled"
154302025-08-01T16:13:49.709ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 17 reason = Timeout
154312025-08-01T16:13:49.709ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
154322025-08-01T16:13:49.709ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 17 reason = Timeout
154332025-08-01T16:13:49.709ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
154342025-08-01T16:13:49.709ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 17 reason = Timeout
154352025-08-01T16:13:49.709ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
154362025-08-01T16:13:49.709ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
154372025-08-01T16:13:49.709ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 17 reason = Timeout
154382025-08-01T16:13:49.709ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
154392025-08-01T16:13:49.709ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 17 reason = Timeout
154402025-08-01T16:13:49.709ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 17 reason = Timeout
154412025-08-01T16:13:49.709ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
154422025-08-01T16:13:49.709ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
154432025-08-01T16:13:49.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
154442025-08-01T16:13:49.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
154452025-08-01T16:13:49.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
154462025-08-01T16:13:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
154472025-08-01T16:13:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
154482025-08-01T16:13:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
154492025-08-01T16:13:49.712ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
154502025-08-01T16:13:49.714ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
154512025-08-01T16:13:49.714ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 4.874568ms iteration = 17 status = {"by_rx":{},"error":null}
154522025-08-01T16:13:49.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
154532025-08-01T16:13:49.715ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
154542025-08-01T16:13:49.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
154552025-08-01T16:13:49.716ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 6.890869ms iteration = 17 status = {"errors":[],"found_port_ok":[]}
154562025-08-01T16:13:49.719ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
154572025-08-01T16:13:49.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
154582025-08-01T16:13:49.725ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 16.259143ms iteration = 17 status = {"dispatched":[],"errors":[],"glob_version":"173.0.0","globs_reprocessed":{},"no_receivers":[]}
154592025-08-01T16:13:49.749ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
154602025-08-01T16:13:49.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
154612025-08-01T16:13:49.750ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
154622025-08-01T16:13:49.750ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
154632025-08-01T16:13:49.750ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
154642025-08-01T16:13:49.750ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
154652025-08-01T16:13:49.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
154662025-08-01T16:13:49.751ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
154672025-08-01T16:13:49.752ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
154682025-08-01T16:13:49.753ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
154692025-08-01T16:13:49.753ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
154702025-08-01T16:13:49.753ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
154712025-08-01T16:13:49.753ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
154722025-08-01T16:13:49.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
154732025-08-01T16:13:49.754ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
154742025-08-01T16:13:49.754ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
154752025-08-01T16:13:49.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
154762025-08-01T16:13:49.755ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
154772025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 33 reason = Timeout
154782025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 33 reason = Timeout
154792025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 16.341\u{b5}s iteration = 33 status = {"disabled":true,"errors":[],"sps":[]}
154802025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
154812025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 33 reason = Timeout
154822025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 34 reason = Timeout
154832025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
154842025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
154852025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 36 reason = Timeout
154862025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 34 reason = Timeout
154872025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
154882025-08-01T16:13:49.758ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
154892025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
154902025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 34 reason = Timeout
154912025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
154922025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
154932025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 97 reason = Timeout
154942025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
154952025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 193 reason = Timeout
154962025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
154972025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 33 reason = Timeout
154982025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
154992025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 33 reason = Timeout
155002025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
155012025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 33 reason = Timeout
155022025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
155032025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 33 reason = Timeout
155042025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
155052025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 33 reason = Timeout
155062025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
155072025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 33 reason = Timeout
155082025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
155092025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 33 reason = Timeout
155102025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
155112025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 33 reason = Timeout
155122025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
155132025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 97 reason = Timeout
155142025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
155152025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
155162025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
155172025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
155182025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
155192025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
155202025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
155212025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
155222025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
155232025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
155242025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
155252025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
155262025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
155272025-08-01T16:13:49.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
155282025-08-01T16:13:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
155292025-08-01T16:13:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
155302025-08-01T16:13:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
155312025-08-01T16:13:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
155322025-08-01T16:13:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
155332025-08-01T16:13:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
155342025-08-01T16:13:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
155352025-08-01T16:13:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
155362025-08-01T16:13:49.759ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
155372025-08-01T16:13:49.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
155382025-08-01T16:13:49.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
155392025-08-01T16:13:49.761ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
155402025-08-01T16:13:49.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
155412025-08-01T16:13:49.762ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
155422025-08-01T16:13:49.762ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
155432025-08-01T16:13:49.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
155442025-08-01T16:13:49.764ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
155452025-08-01T16:13:49.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
155462025-08-01T16:13:49.765ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
155472025-08-01T16:13:49.765ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
155482025-08-01T16:13:49.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
155492025-08-01T16:13:49.766ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
155502025-08-01T16:13:49.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
155512025-08-01T16:13:49.766ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
155522025-08-01T16:13:49.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
155532025-08-01T16:13:49.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
155542025-08-01T16:13:49.767ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
155552025-08-01T16:13:49.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
155562025-08-01T16:13:49.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
155572025-08-01T16:13:49.768ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
155582025-08-01T16:13:49.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
155592025-08-01T16:13:49.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
155602025-08-01T16:13:49.768ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
155612025-08-01T16:13:49.768ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
155622025-08-01T16:13:49.768ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 59.34243ms iteration = 17 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
155632025-08-01T16:13:49.770ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
155642025-08-01T16:13:49.770ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
155652025-08-01T16:13:49.770ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
155662025-08-01T16:13:49.770ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 61.198275ms iteration = 17 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
155672025-08-01T16:13:49.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
155682025-08-01T16:13:49.771ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
155692025-08-01T16:13:49.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
155702025-08-01T16:13:49.772ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
155712025-08-01T16:13:49.772ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
155722025-08-01T16:13:49.772ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 14.128699ms iteration = 193 status = {"chicken_switches_updated":false}
155732025-08-01T16:13:49.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
155742025-08-01T16:13:49.773ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-c9f3bda2-4996-4bda-a233-772410078d0a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 44525, tv_nsec: 790292589 } })
155752025-08-01T16:13:49.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
155762025-08-01T16:13:49.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
155772025-08-01T16:13:49.773ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
155782025-08-01T16:13:49.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
155792025-08-01T16:13:49.774ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
155802025-08-01T16:13:49.774ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
155812025-08-01T16:13:49.774ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
155822025-08-01T16:13:49.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
155832025-08-01T16:13:49.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
155842025-08-01T16:13:49.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
155852025-08-01T16:13:49.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
155862025-08-01T16:13:49.776ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
155872025-08-01T16:13:49.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
155882025-08-01T16:13:49.777ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
155892025-08-01T16:13:49.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d307f73a-4e9b-447a-81e0-8bc39130eee1, lookup_type: ById(d307f73a-4e9b-447a-81e0-8bc39130eee1) } result = Ok(())
155902025-08-01T16:13:49.782ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
155912025-08-01T16:13:49.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
155922025-08-01T16:13:49.815ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 original_time_created = 2025-08-01 15:57:48.237949 UTC target_id = d307f73a-4e9b-447a-81e0-8bc39130eee1 time_created = 2025-08-01 15:57:48.237949 UTC
155932025-08-01T16:13:49.815ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.819062ms iteration = 97 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d307f73a-4e9b-447a-81e0-8bc39130eee1","time_created":"2025-08-01T15:57:48.237949Z"}
155942025-08-01T16:13:49.819ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
155952025-08-01T16:13:49.828ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
155962025-08-01T16:13:49.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
155972025-08-01T16:13:49.831ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-01T15:57:44.766264Z, time_modified: 2025-08-01T15:57:44.766264Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: eec17da7-eb17-4917-8728-908698b69bbe, db_silo: Silo { identity: SiloIdentity { id: eec17da7-eb17-4917-8728-908698b69bbe, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-01T15:58:34.653875Z, time_modified: 2025-08-01T15:58:34.653875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: eec17da7-eb17-4917-8728-908698b69bbe, db_silo: Silo { identity: SiloIdentity { id: eec17da7-eb17-4917-8728-908698b69bbe, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-01T15:58:34.653875Z, time_modified: 2025-08-01T15:58:34.653875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575" }] }) }
155982025-08-01T16:13:49.831ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 144.327896ms iteration = 17 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"eec17da7-eb17-4917-8728-908698b69bbe","tls_certs":["b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575"]}},"default_endpoint":{"silo_id":"eec17da7-eb17-4917-8728-908698b69bbe","tls_certs":["b6f4c82dda434c1fe4dfe12aa04a15c86f0317cce87299483f5ba01fb2fc4575"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
155992025-08-01T16:13:49.831ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 73.316413ms iteration = 33 status = {"errors":[],"requests_created_ok":[]}
156002025-08-01T16:13:49.831ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
156012025-08-01T16:13:49.834ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
156022025-08-01T16:13:49.835ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
156032025-08-01T16:13:49.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
156042025-08-01T16:13:49.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
156052025-08-01T16:13:49.835ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
156062025-08-01T16:13:49.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
156072025-08-01T16:13:49.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
156082025-08-01T16:13:49.835ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
156092025-08-01T16:13:49.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
156102025-08-01T16:13:49.836ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
156112025-08-01T16:13:49.836ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 78.529651ms iteration = 33 status = {"errors":[],"garbage_collect_requested":[]}
156122025-08-01T16:13:49.837ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
156132025-08-01T16:13:49.837ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
156142025-08-01T16:13:49.837ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
156152025-08-01T16:13:49.837ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
156162025-08-01T16:13:49.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
156172025-08-01T16:13:49.839ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 80.772289ms iteration = 33 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
156182025-08-01T16:13:49.839ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
156192025-08-01T16:13:49.839ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 81.375338ms iteration = 33 status = {"errors":[],"finish_invoked_ok":[]}
156202025-08-01T16:13:49.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
156212025-08-01T16:13:49.840ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
156222025-08-01T16:13:49.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
156232025-08-01T16:13:49.841ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
156242025-08-01T16:13:49.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
156252025-08-01T16:13:49.841ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
156262025-08-01T16:13:49.841ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
156272025-08-01T16:13:49.841ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
156282025-08-01T16:13:49.842ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
156292025-08-01T16:13:49.842ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6482e44c-c860-4033-b945-5707d343a59d dns_zone_name = oxide.test found_so_far = 0 version = 2
156302025-08-01T16:13:49.842ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
156312025-08-01T16:13:49.842ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
156322025-08-01T16:13:49.842ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
156332025-08-01T16:13:49.842ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b3d8cf0-88ae-40a2-bbef-ae11e7daa96d", "content-length": "26", "date": "Fri, 01 Aug 2025 16:13:49 GMT"} })
156342025-08-01T16:13:49.842ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
156352025-08-01T16:13:49.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
156362025-08-01T16:13:49.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
156372025-08-01T16:13:49.844ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
156382025-08-01T16:13:49.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
156392025-08-01T16:13:49.844ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
156402025-08-01T16:13:49.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
156412025-08-01T16:13:49.849ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
156422025-08-01T16:13:49.849ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 02fcb774-aa43-4052-9996-b85e2d1358b5 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
156432025-08-01T16:13:49.849ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
156442025-08-01T16:13:49.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
156452025-08-01T16:13:49.850ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
156462025-08-01T16:13:49.850ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 92.02451ms iteration = 33 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
156472025-08-01T16:13:49.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
156482025-08-01T16:13:49.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
156492025-08-01T16:13:49.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
156502025-08-01T16:13:49.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
156512025-08-01T16:13:49.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
156522025-08-01T16:13:49.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
156532025-08-01T16:13:49.858ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
156542025-08-01T16:13:49.861ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6482e44c-c860-4033-b945-5707d343a59d dns_zone_name = oxide.test found_so_far = 4 version = 2
156552025-08-01T16:13:49.861ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
156562025-08-01T16:13:49.861ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-01 15:58:34.713515 UTC dns_group = external generation = 2
156572025-08-01T16:13:49.861ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 173.81921ms iteration = 17 status = {"generation":2}
156582025-08-01T16:13:49.862ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
156592025-08-01T16:13:49.862ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
156602025-08-01T16:13:49.862ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "66c86fa9-1752-42e4-b2c1-5ce93a87a2f6", "content-length": "26", "date": "Fri, 01 Aug 2025 16:13:49 GMT"} })
156612025-08-01T16:13:49.862ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
156622025-08-01T16:13:49.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
156632025-08-01T16:13:49.863ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
156642025-08-01T16:13:49.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
156652025-08-01T16:13:49.865ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
156662025-08-01T16:13:49.866ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
156672025-08-01T16:13:49.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
156682025-08-01T16:13:49.867ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 02fcb774-aa43-4052-9996-b85e2d1358b5 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
156692025-08-01T16:13:49.867ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
156702025-08-01T16:13:49.867ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-01 15:58:34.032744 UTC dns_group = internal generation = 1
156712025-08-01T16:13:49.867ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 180.420431ms iteration = 17 status = {"generation":1}
156722025-08-01T16:13:49.868ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
156732025-08-01T16:13:49.872ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
156742025-08-01T16:13:49.872ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
156752025-08-01T16:13:49.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
156762025-08-01T16:13:49.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 117.696139ms iteration = 33 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
156772025-08-01T16:13:49.877ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
156782025-08-01T16:13:49.880ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
156792025-08-01T16:13:49.881ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
156802025-08-01T16:13:49.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
156812025-08-01T16:13:49.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
156822025-08-01T16:13:49.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
156832025-08-01T16:13:49.911ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 153.033751ms iteration = 33 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
156842025-08-01T16:13:49.913ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 155.105153ms iteration = 97 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
156852025-08-01T16:13:49.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 842 local_addr = [fd00:1122:3344:101::a]:59746 method = GET remote_addr = [fd00:1122:3344:101::d]:57824 req_id = f7017cc5-5bd6-497f-8731-d76866be70f4 response_code = 200 uri = /7248190d-c184-423c-8431-31fe40a79e2e
156862025-08-01T16:13:49.924ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
156872025-08-01T16:13:49.924ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
156882025-08-01T16:13:49.924ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 166.620683ms iteration = 34 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
156892025-08-01T16:13:49.928ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
156902025-08-01T16:13:49.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
156912025-08-01T16:13:49.931ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
156922025-08-01T16:13:49.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
156932025-08-01T16:13:49.933ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
156942025-08-01T16:13:49.938ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c9f3bda2-4996-4bda-a233-772410078d0a, lookup_type: ById(c9f3bda2-4996-4bda-a233-772410078d0a) } result = Ok(())
156952025-08-01T16:13:49.938ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
156962025-08-01T16:13:49.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
156972025-08-01T16:13:49.944ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:391
156982025-08-01T16:13:49.944ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 186.213936ms iteration = 33 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
156992025-08-01T16:13:49.944ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 186.486294ms iteration = 33 status = 0
157002025-08-01T16:13:49.949ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
157012025-08-01T16:13:49.949ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
157022025-08-01T16:13:49.949ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe9ad301-470f-42d2-9ddd-f6ffe13da941", "content-length": "372", "date": "Fri, 01 Aug 2025 16:13:49 GMT"} })
157032025-08-01T16:13:49.949ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
157042025-08-01T16:13:49.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
157052025-08-01T16:13:49.966ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
157062025-08-01T16:13:49.966ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
157072025-08-01T16:13:49.966ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b780801c-fe63-4258-9357-6cf44a2ea6ba", "date": "Fri, 01 Aug 2025 16:13:49 GMT"} })
157082025-08-01T16:13:49.966ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
157092025-08-01T16:13:49.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
157102025-08-01T16:13:49.971ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
157112025-08-01T16:13:49.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
157122025-08-01T16:13:49.975ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
157132025-08-01T16:13:49.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
157142025-08-01T16:13:49.980ZINFOnexus (BackgroundTasks): VPC route manager sled c9f3bda2-4996-4bda-a233-772410078d0a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
157152025-08-01T16:13:49.980ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
157162025-08-01T16:13:49.980ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f8099507-15b2-4ef2-9b05-e90b79a1d7fa", "date": "Fri, 01 Aug 2025 16:13:49 GMT"} })
157172025-08-01T16:13:49.983ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 224.738624ms iteration = 34 status = {}
157182025-08-01T16:13:50.005ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 247.226306ms iteration = 36 status = {"physical_disks_added":0}
157192025-08-01T16:13:50.016ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 329.541262ms iteration = 33 status = {}
157202025-08-01T16:13:50.027ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
157212025-08-01T16:13:50.028ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
157222025-08-01T16:13:50.028ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d1d8e6f8-80eb-4526-82b0-996f3b6fe019", "date": "Fri, 01 Aug 2025 16:13:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
157232025-08-01T16:13:50.028ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
157242025-08-01T16:13:50.031ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "a1b68f41-8071-4d86-8492-8100bbf8017a", "date": "Fri, 01 Aug 2025 16:13:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
157252025-08-01T16:13:50.031ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
157262025-08-01T16:13:50.033ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
157272025-08-01T16:13:50.033ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 345.719102ms iteration = 19 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
157282025-08-01T16:13:50.039ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
157292025-08-01T16:13:50.039ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 329.648955ms iteration = 17 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
157302025-08-01T16:13:50.046ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 zone_address = fd00:1122:3344:101::2
157312025-08-01T16:13:50.046ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
157322025-08-01T16:13:50.046ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb874aa1-ef41-4c90-abb1-084e3c37c8b1", "content-length": "26", "date": "Fri, 01 Aug 2025 16:13:49 GMT"} })
157332025-08-01T16:13:50.046ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
157342025-08-01T16:13:50.048ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
157352025-08-01T16:13:50.103ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
157362025-08-01T16:13:50.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
157372025-08-01T16:13:50.106ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 419.002874ms iteration = 33 status = null
157382025-08-01T16:13:50.124ZDEBGnexus (BackgroundTasks): client request SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
157392025-08-01T16:13:50.124ZDEBGnexus (BackgroundTasks): client response SledAgent = c9f3bda2-4996-4bda-a233-772410078d0a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e5e6c8d-1579-4623-9a6a-b2a256dd76be", "content-length": "691", "date": "Fri, 01 Aug 2025 16:13:49 GMT"} })
157402025-08-01T16:13:50.124ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
157412025-08-01T16:13:50.124ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
157422025-08-01T16:13:50.124ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
157432025-08-01T16:13:50.126ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 368.110642ms iteration = 34 status = {}
157442025-08-01T16:13:50.136ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
157452025-08-01T16:13:50.136ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "cd1e13ff-7673-4faa-9ac3-08730764cea3", "date": "Fri, 01 Aug 2025 16:13:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
157462025-08-01T16:13:50.136ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
157472025-08-01T16:13:50.138ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "41289563-08df-49be-b27f-b6f33551c0aa", "date": "Fri, 01 Aug 2025 16:13:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
157482025-08-01T16:13:50.138ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
157492025-08-01T16:13:50.140ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7979c0f5-555d-4bd8-a656-67bc9d374e9d", "date": "Fri, 01 Aug 2025 16:13:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
157502025-08-01T16:13:50.140ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
157512025-08-01T16:13:50.142ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
157522025-08-01T16:13:50.142ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 454.933444ms iteration = 19 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
157532025-08-01T16:13:50.200ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
157542025-08-01T16:13:50.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
157552025-08-01T16:13:50.203ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 3f21d9d5-3adf-463a-a05d-bc2e2e5d64ca, rack_id: 3db2c3c4-412a-4304-b83c-38a163ea2107, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(4c7da70d-ede0-4107-abc5-5650a053be38) } rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
157562025-08-01T16:13:50.203ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
157572025-08-01T16:13:50.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
157582025-08-01T16:13:50.216ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
157592025-08-01T16:13:50.216ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 4c7da70d-ede0-4107-abc5-5650a053be38
157602025-08-01T16:13:50.216ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
157612025-08-01T16:13:50.216ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
157622025-08-01T16:13:50.216ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
157632025-08-01T16:13:50.216ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
157642025-08-01T16:13:50.216ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
157652025-08-01T16:13:50.216ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
157662025-08-01T16:13:50.216ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
157672025-08-01T16:13:50.216ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
157682025-08-01T16:13:50.216ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107
157692025-08-01T16:13:50.216ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
157702025-08-01T16:13:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
157712025-08-01T16:13:50.219ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch_location = Switch0
157722025-08-01T16:13:50.219ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
157732025-08-01T16:13:50.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 09b5a754-8b50-4e6a-89ac-8d692ca5095b roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
157742025-08-01T16:13:50.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 09b5a754-8b50-4e6a-89ac-8d692ca5095b resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
157752025-08-01T16:13:50.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1852 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 09b5a754-8b50-4e6a-89ac-8d692ca5095b response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
157762025-08-01T16:13:50.330ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "fdd4abd4-15a9-4c17-b401-6a7ae5c1952a", "date": "Fri, 01 Aug 2025 16:13:49 GMT"} })
157772025-08-01T16:13:50.330ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 switch = Switch0
157782025-08-01T16:13:50.330ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
157792025-08-01T16:13:50.337ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3db2c3c4-412a-4304-b83c-38a163ea2107 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2bb2377e-a681-406f-ad94-70c953098171", "content-length": "682", "date": "Fri, 01 Aug 2025 16:13:49 GMT"} })
157802025-08-01T16:13:50.337ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
157812025-08-01T16:13:50.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
157822025-08-01T16:13:50.341ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
157832025-08-01T16:13:50.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
157842025-08-01T16:13:50.344ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
157852025-08-01T16:13:50.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
157862025-08-01T16:13:50.346ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
157872025-08-01T16:13:50.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
157882025-08-01T16:13:50.353ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 595.483216ms iteration = 33 status = {}
157892025-08-01T16:13:50.876ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 6
157902025-08-01T16:13:50.876ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221
157912025-08-01T16:13:50.911ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
157922025-08-01T16:13:50.911ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:63955
157932025-08-01T16:13:50.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:63955 req_id = 8243cbd0-1c79-43d3-b5be-0a804541a3d0 roles = RoleSet { roles: {} } uri = /metrics/producers
157942025-08-01T16:13:50.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:63955 req_id = 8243cbd0-1c79-43d3-b5be-0a804541a3d0 resource = Database result = Ok(()) uri = /metrics/producers
157952025-08-01T16:13:50.995ZINFOnexus: assigned collector to new producer collector_id = 7bf2727d-8ae8-417c-81cf-59aa0ad1690b file = nexus/src/app/oximeter.rs:76 producer_id = 7248190d-c184-423c-8431-31fe40a79e2e
157962025-08-01T16:13:50.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 83735 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:63955 req_id = 8243cbd0-1c79-43d3-b5be-0a804541a3d0 response_code = 201 uri = /metrics/producers
157972025-08-01T16:13:50.995ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "8243cbd0-1c79-43d3-b5be-0a804541a3d0", "content-length": "41", "date": "Fri, 01 Aug 2025 16:13:50 GMT"} })
157982025-08-01T16:13:50.997ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
157992025-08-01T16:13:51.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9d2d6051-30a9-43dc-bad6-718828ff45cc roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
158002025-08-01T16:13:51.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9d2d6051-30a9-43dc-bad6-718828ff45cc resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
158012025-08-01T16:13:51.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1884 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 9d2d6051-30a9-43dc-bad6-718828ff45cc response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
158022025-08-01T16:13:52.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 433a9e1e-fe90-4f25-9cde-a66495d63cd9 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
158032025-08-01T16:13:52.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 433a9e1e-fe90-4f25-9cde-a66495d63cd9 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
158042025-08-01T16:13:52.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2543 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 433a9e1e-fe90-4f25-9cde-a66495d63cd9 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
158052025-08-01T16:13:53.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 641a6bb8-4453-41d1-8276-91ab923ca208 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
158062025-08-01T16:13:53.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 641a6bb8-4453-41d1-8276-91ab923ca208 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
158072025-08-01T16:13:53.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2480 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 641a6bb8-4453-41d1-8276-91ab923ca208 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
158082025-08-01T16:13:54.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dc423162-a936-44d2-9787-aae6e0f71917 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
158092025-08-01T16:13:54.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dc423162-a936-44d2-9787-aae6e0f71917 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
158102025-08-01T16:13:54.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2610 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = dc423162-a936-44d2-9787-aae6e0f71917 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
158112025-08-01T16:13:54.757ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 194 reason = Timeout
158122025-08-01T16:13:54.757ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
158132025-08-01T16:13:54.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
158142025-08-01T16:13:54.760ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
158152025-08-01T16:13:54.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
158162025-08-01T16:13:54.763ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
158172025-08-01T16:13:54.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
158182025-08-01T16:13:54.766ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
158192025-08-01T16:13:54.766ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.386565ms iteration = 194 status = {"chicken_switches_updated":false}
158202025-08-01T16:13:55.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b7a9d8f2-516c-4706-8b36-c7d0cdc954de roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
158212025-08-01T16:13:55.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b7a9d8f2-516c-4706-8b36-c7d0cdc954de resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
158222025-08-01T16:13:55.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2503 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = b7a9d8f2-516c-4706-8b36-c7d0cdc954de response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
158232025-08-01T16:13:56.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 78be4ee2-afe2-4383-a87e-2fb584d6cce3 roles = RoleSet { roles: {} } uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
158242025-08-01T16:13:56.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 78be4ee2-afe2-4383-a87e-2fb584d6cce3 resource = Database result = Ok(()) uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a
158252025-08-01T16:13:56.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2813 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:50147 req_id = 78be4ee2-afe2-4383-a87e-2fb584d6cce3 response_code = 200 uri = /probes/c9f3bda2-4996-4bda-a233-772410078d0a