Max level shown:
12025-06-04T04:45:02.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 7f26d1b2-1c32-4633-a8b7-3ada7e1fbe31 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22025-06-04T04:45:02.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 7f26d1b2-1c32-4633-a8b7-3ada7e1fbe31 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32025-06-04T04:45:02.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 7f26d1b2-1c32-4633-a8b7-3ada7e1fbe31 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
42025-06-04T04:45:03.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 008547f7-a98e-4583-9dfb-96ba169aeaf2 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
52025-06-04T04:45:03.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 008547f7-a98e-4583-9dfb-96ba169aeaf2 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
62025-06-04T04:45:03.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 008547f7-a98e-4583-9dfb-96ba169aeaf2 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
72025-06-04T04:45:04.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = cf76563d-717a-4722-a43c-73519326290b roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
82025-06-04T04:45:04.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = cf76563d-717a-4722-a43c-73519326290b resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
92025-06-04T04:45:04.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1960 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = cf76563d-717a-4722-a43c-73519326290b response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
102025-06-04T04:45:05.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 37de7b3a-9673-42b7-8d68-9615af5b6b95 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
112025-06-04T04:45:05.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 37de7b3a-9673-42b7-8d68-9615af5b6b95 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
122025-06-04T04:45:05.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1970 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 37de7b3a-9673-42b7-8d68-9615af5b6b95 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
132025-06-04T04:45:06.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 73000a30-b63a-4035-baef-399ac7ee494a roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
142025-06-04T04:45:06.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 73000a30-b63a-4035-baef-399ac7ee494a resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
152025-06-04T04:45:06.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1931 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 73000a30-b63a-4035-baef-399ac7ee494a response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
162025-06-04T04:45:06.504ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 533 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = a6c40117-70ca-49ac-800b-ca4cf3804cf2 response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
172025-06-04T04:45:07.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 23156500-d77c-4500-9114-770cde3a59da roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
182025-06-04T04:45:07.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 23156500-d77c-4500-9114-770cde3a59da resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
192025-06-04T04:45:07.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1824 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 23156500-d77c-4500-9114-770cde3a59da response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
202025-06-04T04:45:08.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = ec4df37d-eeca-4c82-92e1-e7da0a73f465 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
212025-06-04T04:45:08.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = ec4df37d-eeca-4c82-92e1-e7da0a73f465 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
222025-06-04T04:45:08.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = ec4df37d-eeca-4c82-92e1-e7da0a73f465 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
232025-06-04T04:45:09.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2595ac2d-866d-4e69-b551-403caa1789ed roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
242025-06-04T04:45:09.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2595ac2d-866d-4e69-b551-403caa1789ed resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
252025-06-04T04:45:09.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2595ac2d-866d-4e69-b551-403caa1789ed response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
262025-06-04T04:45:10.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 56b5c5d9-303d-45f8-988c-90d6cf2f516f roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
272025-06-04T04:45:10.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 56b5c5d9-303d-45f8-988c-90d6cf2f516f resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
282025-06-04T04:45:10.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2057 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 56b5c5d9-303d-45f8-988c-90d6cf2f516f response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
292025-06-04T04:45:10.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
302025-06-04T04:45:10.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
312025-06-04T04:45:10.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
322025-06-04T04:45:10.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
332025-06-04T04:45:10.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
342025-06-04T04:45:10.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
352025-06-04T04:45:10.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
362025-06-04T04:45:10.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
372025-06-04T04:45:10.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
382025-06-04T04:45:10.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
392025-06-04T04:45:10.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
402025-06-04T04:45:10.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
412025-06-04T04:45:10.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
422025-06-04T04:45:10.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
432025-06-04T04:45:10.902ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 7.108898ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
442025-06-04T04:45:10.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
452025-06-04T04:45:10.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1dd88a28-32c4-4490-89f2-ae05402d904c, lookup_type: ById(1dd88a28-32c4-4490-89f2-ae05402d904c) } result = Ok(())
462025-06-04T04:45:10.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
472025-06-04T04:45:10.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
482025-06-04T04:45:10.918ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c original_time_created = 2025-06-04 04:36:14.609521 UTC target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c time_created = 2025-06-04 04:36:14.609521 UTC
492025-06-04T04:45:10.918ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.165451ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","time_created":"2025-06-04T04:36:14.609521Z"}
502025-06-04T04:45:11.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 044301a3-b38e-470a-b3e5-08c4b1f26662 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
512025-06-04T04:45:11.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 044301a3-b38e-470a-b3e5-08c4b1f26662 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
522025-06-04T04:45:11.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1776 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 044301a3-b38e-470a-b3e5-08c4b1f26662 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
532025-06-04T04:45:12.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 4a8d9c81-1cfb-4d16-a7b0-b5a0b63eb45b roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
542025-06-04T04:45:12.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 4a8d9c81-1cfb-4d16-a7b0-b5a0b63eb45b resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
552025-06-04T04:45:12.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1905 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 4a8d9c81-1cfb-4d16-a7b0-b5a0b63eb45b response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
562025-06-04T04:45:13.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c518a46f-4e30-4457-a67e-2b4639efdd11 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
572025-06-04T04:45:13.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c518a46f-4e30-4457-a67e-2b4639efdd11 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
582025-06-04T04:45:13.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2349 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c518a46f-4e30-4457-a67e-2b4639efdd11 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
592025-06-04T04:45:14.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 7cd458d2-88a3-4b9c-b820-054a51a3a9df roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
602025-06-04T04:45:14.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 7cd458d2-88a3-4b9c-b820-054a51a3a9df resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
612025-06-04T04:45:14.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 7cd458d2-88a3-4b9c-b820-054a51a3a9df response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
622025-06-04T04:45:15.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 239426e0-9587-472c-bb8f-a0a22ecc792b roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
632025-06-04T04:45:15.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 239426e0-9587-472c-bb8f-a0a22ecc792b resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
642025-06-04T04:45:15.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2235 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 239426e0-9587-472c-bb8f-a0a22ecc792b response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
652025-06-04T04:45:16.505ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 472 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = 53f6e7b9-bcf9-461c-bab4-ce66d3161604 response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
662025-06-04T04:45:16.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 8e9a9090-f4d3-4179-bd1e-13221bdee1f3 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
672025-06-04T04:45:16.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 8e9a9090-f4d3-4179-bd1e-13221bdee1f3 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
682025-06-04T04:45:16.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1884 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 8e9a9090-f4d3-4179-bd1e-13221bdee1f3 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
692025-06-04T04:45:17.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f194f1f1-d4eb-4ebd-a1af-89d808ff763d roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
702025-06-04T04:45:17.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f194f1f1-d4eb-4ebd-a1af-89d808ff763d resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
712025-06-04T04:45:17.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2710 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f194f1f1-d4eb-4ebd-a1af-89d808ff763d response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
722025-06-04T04:45:18.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 9c3830a2-7400-47f1-8542-c63bd9d772bf roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
732025-06-04T04:45:18.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 9c3830a2-7400-47f1-8542-c63bd9d772bf resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
742025-06-04T04:45:18.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2078 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 9c3830a2-7400-47f1-8542-c63bd9d772bf response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
752025-06-04T04:45:19.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = e4e7de54-c2b5-4de3-9929-107bf5e8011e roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
762025-06-04T04:45:19.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = e4e7de54-c2b5-4de3-9929-107bf5e8011e resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
772025-06-04T04:45:19.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2332 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = e4e7de54-c2b5-4de3-9929-107bf5e8011e response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
782025-06-04T04:45:20.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 84f2d40a-b7c5-4cac-9862-ac94ee7f3802 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
792025-06-04T04:45:20.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 84f2d40a-b7c5-4cac-9862-ac94ee7f3802 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
802025-06-04T04:45:20.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1997 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 84f2d40a-b7c5-4cac-9862-ac94ee7f3802 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
812025-06-04T04:45:20.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
822025-06-04T04:45:20.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
832025-06-04T04:45:20.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
842025-06-04T04:45:20.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
852025-06-04T04:45:20.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
862025-06-04T04:45:20.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
872025-06-04T04:45:20.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
882025-06-04T04:45:20.898ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
892025-06-04T04:45:20.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
902025-06-04T04:45:20.899ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.282494ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
912025-06-04T04:45:20.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
922025-06-04T04:45:20.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
932025-06-04T04:45:20.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
942025-06-04T04:45:20.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
952025-06-04T04:45:20.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
962025-06-04T04:45:20.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
972025-06-04T04:45:20.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1dd88a28-32c4-4490-89f2-ae05402d904c, lookup_type: ById(1dd88a28-32c4-4490-89f2-ae05402d904c) } result = Ok(())
982025-06-04T04:45:20.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
992025-06-04T04:45:20.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1002025-06-04T04:45:20.913ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c original_time_created = 2025-06-04 04:36:14.609521 UTC target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c time_created = 2025-06-04 04:36:14.609521 UTC
1012025-06-04T04:45:20.913ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.201566ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","time_created":"2025-06-04T04:36:14.609521Z"}
1022025-06-04T04:45:21.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 45aeaf2f-bb2d-4005-8485-2246601fb574 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1032025-06-04T04:45:21.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 45aeaf2f-bb2d-4005-8485-2246601fb574 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1042025-06-04T04:45:21.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 45aeaf2f-bb2d-4005-8485-2246601fb574 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1052025-06-04T04:45:22.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3b55bc37-fb0d-4e35-9200-7a8cdc97c208 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1062025-06-04T04:45:22.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3b55bc37-fb0d-4e35-9200-7a8cdc97c208 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1072025-06-04T04:45:22.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2044 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3b55bc37-fb0d-4e35-9200-7a8cdc97c208 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1082025-06-04T04:45:23.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 662c4fc2-d91b-4758-8674-be4f913220d1 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1092025-06-04T04:45:23.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 662c4fc2-d91b-4758-8674-be4f913220d1 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1102025-06-04T04:45:23.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2445 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 662c4fc2-d91b-4758-8674-be4f913220d1 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1112025-06-04T04:45:24.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 94539611-06ad-4f5e-ab1e-ab723a5a7bfa roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1122025-06-04T04:45:24.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 94539611-06ad-4f5e-ab1e-ab723a5a7bfa resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1132025-06-04T04:45:24.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2598 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 94539611-06ad-4f5e-ab1e-ab723a5a7bfa response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1142025-06-04T04:45:25.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3f059f13-772e-48c0-a248-44cf98609456 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1152025-06-04T04:45:25.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3f059f13-772e-48c0-a248-44cf98609456 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1162025-06-04T04:45:25.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2474 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3f059f13-772e-48c0-a248-44cf98609456 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1172025-06-04T04:45:26.505ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 703 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = 1f1716e0-c0df-4770-b31d-0a58d07d133e response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
1182025-06-04T04:45:26.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = ea5e3806-2330-4df8-a949-22a27b4b035c roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1192025-06-04T04:45:26.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = ea5e3806-2330-4df8-a949-22a27b4b035c resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1202025-06-04T04:45:26.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2058 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = ea5e3806-2330-4df8-a949-22a27b4b035c response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1212025-06-04T04:45:27.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 9e8f5c46-b42f-4e1e-8ec5-95e018398e62 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1222025-06-04T04:45:27.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 9e8f5c46-b42f-4e1e-8ec5-95e018398e62 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1232025-06-04T04:45:27.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 9e8f5c46-b42f-4e1e-8ec5-95e018398e62 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1242025-06-04T04:45:28.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 740ef83d-c6e6-41d4-92da-e1c85edc91e1 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1252025-06-04T04:45:28.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 740ef83d-c6e6-41d4-92da-e1c85edc91e1 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1262025-06-04T04:45:28.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2576 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 740ef83d-c6e6-41d4-92da-e1c85edc91e1 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1272025-06-04T04:45:29.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 198cb8c8-b8ed-4052-a558-a76f906659bf roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1282025-06-04T04:45:29.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 198cb8c8-b8ed-4052-a558-a76f906659bf resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1292025-06-04T04:45:29.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3113 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 198cb8c8-b8ed-4052-a558-a76f906659bf response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1302025-06-04T04:45:30.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 40025fd6-e691-4526-a3b3-858276b14cac roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1312025-06-04T04:45:30.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 40025fd6-e691-4526-a3b3-858276b14cac resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1322025-06-04T04:45:30.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2547 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 40025fd6-e691-4526-a3b3-858276b14cac response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
1332025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
1342025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1352025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
1362025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
1372025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
1382025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1392025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
1402025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1412025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
1422025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
1432025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
1442025-06-04T04:45:30.894ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-06-04 04:35:30.894681139 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
1452025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
1462025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
1472025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
1482025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1492025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
1502025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
1512025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1522025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
1532025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
1542025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
1552025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1562025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1572025-06-04T04:45:30.894ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
1582025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1592025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
1602025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
1612025-06-04T04:45:30.894ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1622025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1632025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1642025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
1652025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
1662025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1672025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
1682025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 19 reason = Timeout
1692025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
1702025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1712025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
1722025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
1732025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1742025-06-04T04:45:30.894ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c
1752025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.71\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c"}
1762025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
1772025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1782025-06-04T04:45:30.894ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
1792025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1802025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
1812025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1822025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1832025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
1842025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1852025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
1862025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1872025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1882025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1892025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1902025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
1912025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1922025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1932025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1942025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1952025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1962025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1972025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1982025-06-04T04:45:30.895ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3147fdc0-57b9-465b-97b1-724db3a98549.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fd2bb11e-a66c-4a76-9d9e-ddc3f90ca952.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fd2bb11e-a66c-4a76-9d9e-ddc3f90ca952.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1355, tv_nsec: 60866813 } })
1992025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
2002025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2012025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2022025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2032025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2042025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2052025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2062025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2072025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2082025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2092025-06-04T04:45:30.895ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6bd72d79-86a4-4394-904a-eda88bc21fd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("badd8271-e80d-44a0-993c-76a669a9eadb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f664b51a-ef20-45b7-9cac-a2aa17e449b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f664b51a-ef20-45b7-9cac-a2aa17e449b7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1355, tv_nsec: 60953925 } })
2102025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
2112025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
2122025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2132025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 10 reason = Timeout
2142025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
2152025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
2162025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 10 reason = Timeout
2172025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
2182025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
2192025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
2202025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 19 reason = Timeout
2212025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
2222025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
2232025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
2242025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2252025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
2262025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
2272025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
2282025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2292025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2302025-06-04T04:45:30.895ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
2312025-06-04T04:45:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2322025-06-04T04:45:30.896ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.32234ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
2332025-06-04T04:45:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
2342025-06-04T04:45:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
2352025-06-04T04:45:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
2362025-06-04T04:45:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
2372025-06-04T04:45:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
2382025-06-04T04:45:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2392025-06-04T04:45:30.896ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
2402025-06-04T04:45:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
2412025-06-04T04:45:30.896ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.561854ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
2422025-06-04T04:45:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
2432025-06-04T04:45:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2442025-06-04T04:45:30.896ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2452025-06-04T04:45:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2462025-06-04T04:45:30.896ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2472025-06-04T04:45:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2482025-06-04T04:45:30.897ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2492025-06-04T04:45:30.897ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1355, tv_nsec: 63198689 } })
2502025-06-04T04:45:30.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2512025-06-04T04:45:30.898ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2522025-06-04T04:45:30.898ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
2532025-06-04T04:45:30.898ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.206078ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
2542025-06-04T04:45:30.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2552025-06-04T04:45:30.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2562025-06-04T04:45:30.900ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2572025-06-04T04:45:30.900ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2582025-06-04T04:45:30.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2592025-06-04T04:45:30.900ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-06-04 04:35:30.894681139 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
2602025-06-04T04:45:30.900ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.95799ms iteration = 10 status = {"expiration":"2025-06-04T04:35:30.894681139Z","pruned":[]}
2612025-06-04T04:45:30.901ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1355, tv_nsec: 66615621 } })
2622025-06-04T04:45:30.901ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
2632025-06-04T04:45:30.902ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2642025-06-04T04:45:30.902ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2652025-06-04T04:45:30.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2662025-06-04T04:45:30.904ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2672025-06-04T04:45:30.904ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
2682025-06-04T04:45:30.905ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2692025-06-04T04:45:30.905ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2702025-06-04T04:45:30.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
2712025-06-04T04:45:30.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2722025-06-04T04:45:30.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
2732025-06-04T04:45:30.905ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
2742025-06-04T04:45:30.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2752025-06-04T04:45:30.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2762025-06-04T04:45:30.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2772025-06-04T04:45:30.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2782025-06-04T04:45:30.907ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2792025-06-04T04:45:30.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2802025-06-04T04:45:30.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2812025-06-04T04:45:30.910ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2822025-06-04T04:45:30.910ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2832025-06-04T04:45:30.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2842025-06-04T04:45:30.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2852025-06-04T04:45:30.912ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2862025-06-04T04:45:30.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2872025-06-04T04:45:30.913ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2882025-06-04T04:45:30.913ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2892025-06-04T04:45:30.915ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2902025-06-04T04:45:30.915ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2912025-06-04T04:45:30.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2922025-06-04T04:45:30.916ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2932025-06-04T04:45:30.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2942025-06-04T04:45:30.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
2952025-06-04T04:45:30.917ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2962025-06-04T04:45:30.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2972025-06-04T04:45:30.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2982025-06-04T04:45:30.919ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2992025-06-04T04:45:30.919ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3002025-06-04T04:45:30.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3012025-06-04T04:45:30.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3022025-06-04T04:45:30.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
3032025-06-04T04:45:30.919ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3042025-06-04T04:45:30.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3052025-06-04T04:45:30.919ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3062025-06-04T04:45:30.921ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 25.568768ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
3072025-06-04T04:45:30.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
3082025-06-04T04:45:30.921ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
3092025-06-04T04:45:30.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
3102025-06-04T04:45:30.923ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
3112025-06-04T04:45:30.923ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
3122025-06-04T04:45:30.923ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
3132025-06-04T04:45:30.923ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 27.67601ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
3142025-06-04T04:45:30.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
3152025-06-04T04:45:30.925ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3162025-06-04T04:45:30.925ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
3172025-06-04T04:45:30.925ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 29.614039ms iteration = 10 status = {"by_rx":{},"error":null}
3182025-06-04T04:45:30.926ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3192025-06-04T04:45:30.927ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 32.010176ms iteration = 19 status = {"errors":[],"requests_created_ok":[]}
3202025-06-04T04:45:30.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
3212025-06-04T04:45:30.927ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
3222025-06-04T04:45:30.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
3232025-06-04T04:45:30.928ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3242025-06-04T04:45:30.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
3252025-06-04T04:45:30.930ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
3262025-06-04T04:45:30.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
3272025-06-04T04:45:30.931ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3282025-06-04T04:45:30.932ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3292025-06-04T04:45:30.933ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
3302025-06-04T04:45:30.933ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
3312025-06-04T04:45:30.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
3322025-06-04T04:45:30.935ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3332025-06-04T04:45:30.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3342025-06-04T04:45:30.936ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3352025-06-04T04:45:30.937ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3362025-06-04T04:45:30.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3372025-06-04T04:45:30.939ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3382025-06-04T04:45:30.939ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
3392025-06-04T04:45:30.939ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3402025-06-04T04:45:30.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3412025-06-04T04:45:30.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3422025-06-04T04:45:30.944ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3432025-06-04T04:45:30.945ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1355, tv_nsec: 110696260 } })
3442025-06-04T04:45:30.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3452025-06-04T04:45:30.945ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36
3462025-06-04T04:45:30.947ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
3472025-06-04T04:45:30.947ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 52.461376ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
3482025-06-04T04:45:30.947ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
3492025-06-04T04:45:30.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
3502025-06-04T04:45:30.950ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 55.33356ms iteration = 5 status = {"nsuccess":5}
3512025-06-04T04:45:30.950ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3522025-06-04T04:45:30.955ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3532025-06-04T04:45:30.955ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1dd88a28-32c4-4490-89f2-ae05402d904c, lookup_type: ById(1dd88a28-32c4-4490-89f2-ae05402d904c) } result = Ok(())
3542025-06-04T04:45:30.955ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3552025-06-04T04:45:30.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3562025-06-04T04:45:30.958ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
3572025-06-04T04:45:30.958ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3582025-06-04T04:45:30.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3592025-06-04T04:45:30.972ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3602025-06-04T04:45:30.972ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
3612025-06-04T04:45:30.972ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3622025-06-04T04:45:30.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3632025-06-04T04:45:30.974ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 78.891718ms iteration = 10 status = {"dispatched":[],"errors":[],"glob_version":"146.0.0","globs_reprocessed":{},"no_receivers":[]}
3642025-06-04T04:45:30.992ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 96.284931ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
3652025-06-04T04:45:30.993ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
3662025-06-04T04:45:30.993ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
3672025-06-04T04:45:30.993ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
3682025-06-04T04:45:30.993ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3692025-06-04T04:45:30.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3702025-06-04T04:45:30.996ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3712025-06-04T04:45:31.000ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3722025-06-04T04:45:31.002ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 107.088596ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
3732025-06-04T04:45:31.003ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3742025-06-04T04:45:31.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3752025-06-04T04:45:31.005ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
3762025-06-04T04:45:31.005ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
3772025-06-04T04:45:31.005ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 110.950814ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
3782025-06-04T04:45:31.008ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 113.392481ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3792025-06-04T04:45:31.009ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
3802025-06-04T04:45:31.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
3812025-06-04T04:45:31.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 117.158318ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
3822025-06-04T04:45:31.014ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3832025-06-04T04:45:31.017ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 123.017397ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
3842025-06-04T04:45:31.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
3852025-06-04T04:45:31.018ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3862025-06-04T04:45:31.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3872025-06-04T04:45:31.022ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3882025-06-04T04:45:31.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3892025-06-04T04:45:31.045ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
3902025-06-04T04:45:31.045ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3912025-06-04T04:45:31.046ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb77f659-caf2-4ea5-995e-e66300071375", "content-length": "26", "date": "Wed, 04 Jun 2025 04:45:30 GMT"} })
3922025-06-04T04:45:31.046ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3932025-06-04T04:45:31.047ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3942025-06-04T04:45:31.047ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
3952025-06-04T04:45:31.047ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
3962025-06-04T04:45:31.047ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
3972025-06-04T04:45:31.047ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3982025-06-04T04:45:31.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3992025-06-04T04:45:31.049ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
4002025-06-04T04:45:31.091ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4012025-06-04T04:45:31.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4022025-06-04T04:45:31.103ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
4032025-06-04T04:45:31.104ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 209.060843ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
4042025-06-04T04:45:31.111ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 zone_address = fd00:1122:3344:101::2
4052025-06-04T04:45:31.111ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4062025-06-04T04:45:31.112ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7cce8585-aeab-4043-b1c3-9e4856eed49b", "content-length": "26", "date": "Wed, 04 Jun 2025 04:45:30 GMT"} })
4072025-06-04T04:45:31.112ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4082025-06-04T04:45:31.113ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36
4092025-06-04T04:45:31.113ZINFOnexus (BackgroundTasks): VPC route manager sled cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
4102025-06-04T04:45:31.113ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4112025-06-04T04:45:31.114ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1ee3857-66d6-4d25-9386-a8cf288086f0", "content-length": "372", "date": "Wed, 04 Jun 2025 04:45:30 GMT"} })
4122025-06-04T04:45:31.114ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4132025-06-04T04:45:31.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4142025-06-04T04:45:31.116ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
4152025-06-04T04:45:31.116ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
4162025-06-04T04:45:31.116ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4172025-06-04T04:45:31.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4182025-06-04T04:45:31.117ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4192025-06-04T04:45:31.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4202025-06-04T04:45:31.132ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
4212025-06-04T04:45:31.134ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4222025-06-04T04:45:31.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4232025-06-04T04:45:31.143ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c original_time_created = 2025-06-04 04:36:14.609521 UTC target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c time_created = 2025-06-04 04:36:14.609521 UTC
4242025-06-04T04:45:31.143ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 248.250837ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","time_created":"2025-06-04T04:36:14.609521Z"}
4252025-06-04T04:45:31.171ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 276.221612ms iteration = 21 status = {"physical_disks_added":0}
4262025-06-04T04:45:31.171ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4272025-06-04T04:45:31.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
4282025-06-04T04:45:31.175ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4292025-06-04T04:45:31.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4302025-06-04T04:45:31.176ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4312025-06-04T04:45:31.176ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
4322025-06-04T04:45:31.176ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
4332025-06-04T04:45:31.176ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 281.195277ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
4342025-06-04T04:45:31.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4352025-06-04T04:45:31.177ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4362025-06-04T04:45:31.179ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 283.417012ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
4372025-06-04T04:45:31.179ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
4382025-06-04T04:45:31.179ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4392025-06-04T04:45:31.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4402025-06-04T04:45:31.179ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4412025-06-04T04:45:31.181ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4422025-06-04T04:45:31.183ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 288.837534ms iteration = 19 status = {}
4432025-06-04T04:45:31.183ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4442025-06-04T04:45:31.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
4452025-06-04T04:45:31.184ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4462025-06-04T04:45:31.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4472025-06-04T04:45:31.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cb8aa4e2-773a-4f3e-86b7-f32104e9c4de, lookup_type: ById(cb8aa4e2-773a-4f3e-86b7-f32104e9c4de) } result = Ok(())
4482025-06-04T04:45:31.184ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4492025-06-04T04:45:31.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4502025-06-04T04:45:31.186ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 291.292761ms iteration = 19 status = 0
4512025-06-04T04:45:31.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
4522025-06-04T04:45:31.186ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
4532025-06-04T04:45:31.186ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
4542025-06-04T04:45:31.186ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
4552025-06-04T04:45:31.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
4562025-06-04T04:45:31.187ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "30451f2b-abad-434a-aa53-2c011b6c4cc6", "date": "Wed, 04 Jun 2025 04:45:30 GMT"} })
4572025-06-04T04:45:31.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4582025-06-04T04:45:31.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4592025-06-04T04:45:31.189ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4602025-06-04T04:45:31.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4612025-06-04T04:45:31.193ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4622025-06-04T04:45:31.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4632025-06-04T04:45:31.195ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
4642025-06-04T04:45:31.196ZINFOnexus (BackgroundTasks): VPC route manager sled cb8aa4e2-773a-4f3e-86b7-f32104e9c4de push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
4652025-06-04T04:45:31.196ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4662025-06-04T04:45:31.196ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c5c92e6c-951f-475c-a5df-1a694f1a72b8", "date": "Wed, 04 Jun 2025 04:45:30 GMT"} })
4672025-06-04T04:45:31.198ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
4682025-06-04T04:45:31.198ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4692025-06-04T04:45:31.198ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 303.679279ms iteration = 19 status = {}
4702025-06-04T04:45:31.198ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6216e3fa-4d2f-4318-8930-37f3f7b0b546", "content-length": "26", "date": "Wed, 04 Jun 2025 04:45:30 GMT"} })
4712025-06-04T04:45:31.198ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4722025-06-04T04:45:31.200ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4732025-06-04T04:45:31.213ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
4742025-06-04T04:45:31.213ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ce77201a-6012-44b3-bdd1-aa82b5d93c9b dns_zone_name = oxide.test found_so_far = 0 version = 2
4752025-06-04T04:45:31.213ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4762025-06-04T04:45:31.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4772025-06-04T04:45:31.215ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4782025-06-04T04:45:31.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
4792025-06-04T04:45:31.218ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4802025-06-04T04:45:31.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4812025-06-04T04:45:31.219ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-06-04T04:36:26.716717Z, time_modified: 2025-06-04T04:36:26.716717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 6ac9285f-aca7-426a-86f8-a677f8a85ac2, db_silo: Silo { identity: SiloIdentity { id: 6ac9285f-aca7-426a-86f8-a677f8a85ac2, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-04T04:36:32.675073Z, time_modified: 2025-06-04T04:36:32.675073Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "26b91f4e65966da67879de126c5f5f1398a4ef21b95a2113db132d6cfa56d902" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 6ac9285f-aca7-426a-86f8-a677f8a85ac2, db_silo: Silo { identity: SiloIdentity { id: 6ac9285f-aca7-426a-86f8-a677f8a85ac2, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-04T04:36:32.675073Z, time_modified: 2025-06-04T04:36:32.675073Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "26b91f4e65966da67879de126c5f5f1398a4ef21b95a2113db132d6cfa56d902" }] }) }
4822025-06-04T04:45:31.219ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 324.979932ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"6ac9285f-aca7-426a-86f8-a677f8a85ac2","tls_certs":["26b91f4e65966da67879de126c5f5f1398a4ef21b95a2113db132d6cfa56d902"]}},"default_endpoint":{"silo_id":"6ac9285f-aca7-426a-86f8-a677f8a85ac2","tls_certs":["26b91f4e65966da67879de126c5f5f1398a4ef21b95a2113db132d6cfa56d902"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
4832025-06-04T04:45:31.220ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ce77201a-6012-44b3-bdd1-aa82b5d93c9b dns_zone_name = oxide.test found_so_far = 4 version = 2
4842025-06-04T04:45:31.220ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
4852025-06-04T04:45:31.220ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-06-04 04:36:32.761780 UTC dns_group = external generation = 2
4862025-06-04T04:45:31.220ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 326.10703ms iteration = 10 status = {"generation":2}
4872025-06-04T04:45:31.228ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
4882025-06-04T04:45:31.228ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 333.480732ms iteration = 19 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
4892025-06-04T04:45:31.230ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
4902025-06-04T04:45:31.230ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 787b83fc-6b83-4eec-b3a2-7c7c59871d86 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
4912025-06-04T04:45:31.230ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4922025-06-04T04:45:31.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4932025-06-04T04:45:31.232ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4942025-06-04T04:45:31.235ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
4952025-06-04T04:45:31.235ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4962025-06-04T04:45:31.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4972025-06-04T04:45:31.238ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 787b83fc-6b83-4eec-b3a2-7c7c59871d86 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
4982025-06-04T04:45:31.238ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
4992025-06-04T04:45:31.238ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-06-04 04:36:31.280949 UTC dns_group = internal generation = 1
5002025-06-04T04:45:31.238ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 344.458168ms iteration = 10 status = {"generation":1}
5012025-06-04T04:45:31.259ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
5022025-06-04T04:45:31.259ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b22e874f-8d8f-43e4-965c-0c33a48c91ad", "date": "Wed, 04 Jun 2025 04:45:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
5032025-06-04T04:45:31.259ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
5042025-06-04T04:45:31.260ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "66c5287f-5972-438e-aeb5-5039f12a354e", "date": "Wed, 04 Jun 2025 04:45:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
5052025-06-04T04:45:31.260ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
5062025-06-04T04:45:31.262ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5072025-06-04T04:45:31.262ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
5082025-06-04T04:45:31.262ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 368.188528ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
5092025-06-04T04:45:31.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5102025-06-04T04:45:31.279ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
5112025-06-04T04:45:31.280ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "9c36a8bb-41af-41b4-b45e-0e3e65d34297", "date": "Wed, 04 Jun 2025 04:45:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
5122025-06-04T04:45:31.280ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
5132025-06-04T04:45:31.282ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "31638e45-255c-47e3-9a8b-1a39a127531b", "date": "Wed, 04 Jun 2025 04:45:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
5142025-06-04T04:45:31.282ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
5152025-06-04T04:45:31.284ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "4ddde879-70d7-439c-a696-00c94d118487", "date": "Wed, 04 Jun 2025 04:45:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
5162025-06-04T04:45:31.284ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
5172025-06-04T04:45:31.286ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
5182025-06-04T04:45:31.286ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 391.489652ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
5192025-06-04T04:45:31.289ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
5202025-06-04T04:45:31.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5212025-06-04T04:45:31.290ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 396.323425ms iteration = 19 status = null
5222025-06-04T04:45:31.295ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5232025-06-04T04:45:31.297ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
5242025-06-04T04:45:31.297ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5252025-06-04T04:45:31.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5262025-06-04T04:45:31.323ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5272025-06-04T04:45:31.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5282025-06-04T04:45:31.325ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: a0769b7e-afb1-46f8-b225-eac4dddfaf8d, rack_id: 5a147cfa-15ac-4bf0-8777-c82b354c8c36, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(913c54af-e122-4277-b509-f8a495f24eae) } rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch_location = Switch0
5292025-06-04T04:45:31.325ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5302025-06-04T04:45:31.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5312025-06-04T04:45:31.328ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5322025-06-04T04:45:31.330ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
5332025-06-04T04:45:31.330ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5342025-06-04T04:45:31.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5352025-06-04T04:45:31.339ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
5362025-06-04T04:45:31.339ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 913c54af-e122-4277-b509-f8a495f24eae
5372025-06-04T04:45:31.339ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
5382025-06-04T04:45:31.339ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
5392025-06-04T04:45:31.339ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5402025-06-04T04:45:31.339ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5412025-06-04T04:45:31.339ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5422025-06-04T04:45:31.339ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
5432025-06-04T04:45:31.339ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5442025-06-04T04:45:31.339ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
5452025-06-04T04:45:31.339ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36
5462025-06-04T04:45:31.339ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5472025-06-04T04:45:31.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5482025-06-04T04:45:31.342ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch_location = Switch0
5492025-06-04T04:45:31.342ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
5502025-06-04T04:45:31.361ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
5512025-06-04T04:45:31.363ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff60ec8b-95a3-46f9-8334-73232346adf4", "content-length": "691", "date": "Wed, 04 Jun 2025 04:45:30 GMT"} })
5522025-06-04T04:45:31.363ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
5532025-06-04T04:45:31.363ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
5542025-06-04T04:45:31.363ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
5552025-06-04T04:45:31.365ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 470.898867ms iteration = 19 status = {}
5562025-06-04T04:45:31.550ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e252d57c-58b9-4170-aefa-a15a8ce18f3e", "date": "Wed, 04 Jun 2025 04:45:31 GMT"} })
5572025-06-04T04:45:31.550ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch = Switch0
5582025-06-04T04:45:31.550ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
5592025-06-04T04:45:31.550ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "02eacb01-7f2b-4326-828a-954e09b88a24", "content-length": "682", "date": "Wed, 04 Jun 2025 04:45:31 GMT"} })
5602025-06-04T04:45:31.550ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5612025-06-04T04:45:31.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5622025-06-04T04:45:31.555ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5632025-06-04T04:45:31.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5642025-06-04T04:45:31.558ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5652025-06-04T04:45:31.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5662025-06-04T04:45:31.561ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5672025-06-04T04:45:31.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5682025-06-04T04:45:31.567ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 672.746371ms iteration = 19 status = {}
5692025-06-04T04:45:31.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c7b9771a-525b-44a1-bdcc-39655a296015 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
5702025-06-04T04:45:31.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c7b9771a-525b-44a1-bdcc-39655a296015 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
5712025-06-04T04:45:31.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2383 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c7b9771a-525b-44a1-bdcc-39655a296015 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
5722025-06-04T04:45:32.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 723f9a67-8a7c-494f-8244-b1d834b10e0b roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
5732025-06-04T04:45:32.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 723f9a67-8a7c-494f-8244-b1d834b10e0b resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
5742025-06-04T04:45:32.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1983 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 723f9a67-8a7c-494f-8244-b1d834b10e0b response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
5752025-06-04T04:45:33.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 220bf44d-ad4d-4304-8b01-a19c60d92967 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
5762025-06-04T04:45:33.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 220bf44d-ad4d-4304-8b01-a19c60d92967 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
5772025-06-04T04:45:33.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2082 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 220bf44d-ad4d-4304-8b01-a19c60d92967 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
5782025-06-04T04:45:34.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 312701df-7546-43f1-90cc-9a96880f376d roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
5792025-06-04T04:45:34.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 312701df-7546-43f1-90cc-9a96880f376d resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
5802025-06-04T04:45:34.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2411 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 312701df-7546-43f1-90cc-9a96880f376d response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
5812025-06-04T04:45:35.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 43e2a765-1279-4a0d-881e-5f6f08faa471 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
5822025-06-04T04:45:35.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 43e2a765-1279-4a0d-881e-5f6f08faa471 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
5832025-06-04T04:45:35.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2403 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 43e2a765-1279-4a0d-881e-5f6f08faa471 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
5842025-06-04T04:45:36.504ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 584 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = f532d325-3260-40be-8a2c-a75afbf422b7 response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
5852025-06-04T04:45:36.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = d7a3e717-ef42-4916-a372-b390cdf98c38 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
5862025-06-04T04:45:36.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = d7a3e717-ef42-4916-a372-b390cdf98c38 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
5872025-06-04T04:45:36.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2327 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = d7a3e717-ef42-4916-a372-b390cdf98c38 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
5882025-06-04T04:45:37.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f2a175e5-caa7-4630-957f-a786b5cfce37 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
5892025-06-04T04:45:37.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f2a175e5-caa7-4630-957f-a786b5cfce37 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
5902025-06-04T04:45:37.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f2a175e5-caa7-4630-957f-a786b5cfce37 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
5912025-06-04T04:45:38.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = d78b2b1f-b50b-4730-a94d-340b0f8948ad roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
5922025-06-04T04:45:38.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = d78b2b1f-b50b-4730-a94d-340b0f8948ad resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
5932025-06-04T04:45:38.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1947 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = d78b2b1f-b50b-4730-a94d-340b0f8948ad response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
5942025-06-04T04:45:39.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = ad963759-b3a9-490d-938f-92d880a3dfa7 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
5952025-06-04T04:45:39.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = ad963759-b3a9-490d-938f-92d880a3dfa7 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
5962025-06-04T04:45:39.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2312 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = ad963759-b3a9-490d-938f-92d880a3dfa7 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
5972025-06-04T04:45:40.894ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
5982025-06-04T04:45:40.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5992025-06-04T04:45:40.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
6002025-06-04T04:45:40.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6012025-06-04T04:45:40.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 578c37b4-09d8-4387-b89a-7e9f2b66cb8d roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6022025-06-04T04:45:40.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6032025-06-04T04:45:40.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 578c37b4-09d8-4387-b89a-7e9f2b66cb8d resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6042025-06-04T04:45:40.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6052025-06-04T04:45:40.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6062025-06-04T04:45:40.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2761 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 578c37b4-09d8-4387-b89a-7e9f2b66cb8d response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6072025-06-04T04:45:40.898ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6082025-06-04T04:45:40.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6092025-06-04T04:45:40.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6102025-06-04T04:45:40.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6112025-06-04T04:45:40.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6122025-06-04T04:45:40.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6132025-06-04T04:45:40.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6142025-06-04T04:45:40.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6152025-06-04T04:45:40.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1dd88a28-32c4-4490-89f2-ae05402d904c, lookup_type: ById(1dd88a28-32c4-4490-89f2-ae05402d904c) } result = Ok(())
6162025-06-04T04:45:40.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6172025-06-04T04:45:40.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6182025-06-04T04:45:40.917ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c original_time_created = 2025-06-04 04:36:14.609521 UTC target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c time_created = 2025-06-04 04:36:14.609521 UTC
6192025-06-04T04:45:40.917ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.481711ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","time_created":"2025-06-04T04:36:14.609521Z"}
6202025-06-04T04:45:40.928ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.943825ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6212025-06-04T04:45:41.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3335b2ab-31e9-46b5-b9bd-1b4b07e5dd49 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6222025-06-04T04:45:41.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3335b2ab-31e9-46b5-b9bd-1b4b07e5dd49 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6232025-06-04T04:45:41.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2060 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3335b2ab-31e9-46b5-b9bd-1b4b07e5dd49 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6242025-06-04T04:45:42.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 9ec2c403-3d51-419c-a793-78abc079f133 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6252025-06-04T04:45:42.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 9ec2c403-3d51-419c-a793-78abc079f133 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6262025-06-04T04:45:42.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2424 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 9ec2c403-3d51-419c-a793-78abc079f133 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6272025-06-04T04:45:43.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 37457513-76cb-4503-8196-f5d42034a8b7 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6282025-06-04T04:45:43.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 37457513-76cb-4503-8196-f5d42034a8b7 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6292025-06-04T04:45:43.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2710 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 37457513-76cb-4503-8196-f5d42034a8b7 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6302025-06-04T04:45:44.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 63fc1333-9fba-470a-918f-3e68c827eb3f roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6312025-06-04T04:45:44.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 63fc1333-9fba-470a-918f-3e68c827eb3f resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6322025-06-04T04:45:44.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2505 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 63fc1333-9fba-470a-918f-3e68c827eb3f response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6332025-06-04T04:45:45.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 734318c2-e3d5-423c-b0a2-46f1165a6366 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6342025-06-04T04:45:45.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 734318c2-e3d5-423c-b0a2-46f1165a6366 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6352025-06-04T04:45:45.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2220 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 734318c2-e3d5-423c-b0a2-46f1165a6366 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6362025-06-04T04:45:46.505ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 560 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = 885e1b6c-6e08-4998-b644-a92997ca5d74 response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
6372025-06-04T04:45:46.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f56cd1f6-a625-4a23-a6f9-0b352ed6a77e roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6382025-06-04T04:45:46.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f56cd1f6-a625-4a23-a6f9-0b352ed6a77e resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6392025-06-04T04:45:46.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f56cd1f6-a625-4a23-a6f9-0b352ed6a77e response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6402025-06-04T04:45:48.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 6313f236-6a45-4fc8-95b3-f73405a64c7c roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6412025-06-04T04:45:48.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 6313f236-6a45-4fc8-95b3-f73405a64c7c resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6422025-06-04T04:45:48.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2058 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 6313f236-6a45-4fc8-95b3-f73405a64c7c response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6432025-06-04T04:45:49.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = b25d8aea-61d1-4312-b21f-f6fdb135dc70 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6442025-06-04T04:45:49.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = b25d8aea-61d1-4312-b21f-f6fdb135dc70 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6452025-06-04T04:45:49.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = b25d8aea-61d1-4312-b21f-f6fdb135dc70 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6462025-06-04T04:45:50.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = eeacb29c-8998-469a-b537-5fa93ea138a3 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6472025-06-04T04:45:50.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = eeacb29c-8998-469a-b537-5fa93ea138a3 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6482025-06-04T04:45:50.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2000 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = eeacb29c-8998-469a-b537-5fa93ea138a3 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6492025-06-04T04:45:50.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
6502025-06-04T04:45:50.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
6512025-06-04T04:45:50.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6522025-06-04T04:45:50.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6532025-06-04T04:45:50.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6542025-06-04T04:45:50.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6552025-06-04T04:45:50.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6562025-06-04T04:45:50.897ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6572025-06-04T04:45:50.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6582025-06-04T04:45:50.899ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.467108ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6592025-06-04T04:45:50.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6602025-06-04T04:45:50.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6612025-06-04T04:45:50.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6622025-06-04T04:45:50.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6632025-06-04T04:45:50.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6642025-06-04T04:45:50.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6652025-06-04T04:45:50.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1dd88a28-32c4-4490-89f2-ae05402d904c, lookup_type: ById(1dd88a28-32c4-4490-89f2-ae05402d904c) } result = Ok(())
6662025-06-04T04:45:50.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6672025-06-04T04:45:50.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6682025-06-04T04:45:50.915ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c original_time_created = 2025-06-04 04:36:14.609521 UTC target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c time_created = 2025-06-04 04:36:14.609521 UTC
6692025-06-04T04:45:50.915ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.094505ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","time_created":"2025-06-04T04:36:14.609521Z"}
6702025-06-04T04:45:51.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 204290c3-f038-4e74-9e7f-5fb92ad9f137 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6712025-06-04T04:45:51.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 204290c3-f038-4e74-9e7f-5fb92ad9f137 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6722025-06-04T04:45:51.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1727 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 204290c3-f038-4e74-9e7f-5fb92ad9f137 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6732025-06-04T04:45:52.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 614fe530-6925-42bb-a87d-008a06363ebc roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6742025-06-04T04:45:52.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 614fe530-6925-42bb-a87d-008a06363ebc resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6752025-06-04T04:45:52.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2306 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 614fe530-6925-42bb-a87d-008a06363ebc response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6762025-06-04T04:45:53.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 685a0d6e-4508-47e4-a9a6-a855cf9bdd51 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6772025-06-04T04:45:53.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 685a0d6e-4508-47e4-a9a6-a855cf9bdd51 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6782025-06-04T04:45:53.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2560 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 685a0d6e-4508-47e4-a9a6-a855cf9bdd51 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6792025-06-04T04:45:54.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = b6888282-b6ea-40f0-aba1-9e58c56e3c25 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6802025-06-04T04:45:54.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = b6888282-b6ea-40f0-aba1-9e58c56e3c25 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6812025-06-04T04:45:54.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1947 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = b6888282-b6ea-40f0-aba1-9e58c56e3c25 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6822025-06-04T04:45:55.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3f91f45d-6c1d-43c8-85d0-05d522959ad1 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6832025-06-04T04:45:55.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3f91f45d-6c1d-43c8-85d0-05d522959ad1 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6842025-06-04T04:45:55.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2268 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3f91f45d-6c1d-43c8-85d0-05d522959ad1 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6852025-06-04T04:45:56.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5e343d79-9bfb-4917-a9f7-5421ba19d7fd roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6862025-06-04T04:45:56.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5e343d79-9bfb-4917-a9f7-5421ba19d7fd resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6872025-06-04T04:45:56.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2182 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5e343d79-9bfb-4917-a9f7-5421ba19d7fd response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6882025-06-04T04:45:56.505ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 642 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = 6fbfb4e5-3ce4-4a06-8d70-019eca965854 response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
6892025-06-04T04:45:57.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c50cd1b0-1d35-47a4-a927-69878cb4143c roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6902025-06-04T04:45:57.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c50cd1b0-1d35-47a4-a927-69878cb4143c resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6912025-06-04T04:45:57.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2136 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c50cd1b0-1d35-47a4-a927-69878cb4143c response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6922025-06-04T04:45:58.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 7f58b983-a07d-4033-9ddf-8952ce5ca102 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6932025-06-04T04:45:58.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 7f58b983-a07d-4033-9ddf-8952ce5ca102 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6942025-06-04T04:45:58.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2441 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 7f58b983-a07d-4033-9ddf-8952ce5ca102 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6952025-06-04T04:45:59.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = a81dd39f-8dd5-4d4f-b7b2-4367af23f994 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6962025-06-04T04:45:59.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = a81dd39f-8dd5-4d4f-b7b2-4367af23f994 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6972025-06-04T04:45:59.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1900 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = a81dd39f-8dd5-4d4f-b7b2-4367af23f994 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6982025-06-04T04:46:00.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2fa92500-da8a-4d68-8480-0b1d21c24560 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
6992025-06-04T04:46:00.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2fa92500-da8a-4d68-8480-0b1d21c24560 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
7002025-06-04T04:46:00.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2185 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2fa92500-da8a-4d68-8480-0b1d21c24560 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
7012025-06-04T04:46:00.894ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
7022025-06-04T04:46:00.894ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7032025-06-04T04:46:00.894ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
7042025-06-04T04:46:00.894ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
7052025-06-04T04:46:00.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7062025-06-04T04:46:00.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
7072025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
7082025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
7092025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
7102025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7112025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7122025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7132025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
7142025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
7152025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
7162025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7172025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7182025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
7192025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
7202025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7212025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
7222025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7232025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
7242025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
7252025-06-04T04:46:00.895ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
7262025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7272025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7282025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 20 reason = Timeout
7292025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
7302025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7312025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7322025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7332025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7342025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7352025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7362025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7372025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7382025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7392025-06-04T04:46:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7402025-06-04T04:46:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7412025-06-04T04:46:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7422025-06-04T04:46:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7432025-06-04T04:46:00.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
7442025-06-04T04:46:00.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7452025-06-04T04:46:00.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
7462025-06-04T04:46:00.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
7472025-06-04T04:46:00.896ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 20 reason = Timeout
7482025-06-04T04:46:00.896ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
7492025-06-04T04:46:00.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
7502025-06-04T04:46:00.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
7512025-06-04T04:46:00.897ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
7522025-06-04T04:46:00.897ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
7532025-06-04T04:46:00.897ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
7542025-06-04T04:46:00.897ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
7552025-06-04T04:46:00.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7562025-06-04T04:46:00.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
7572025-06-04T04:46:00.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7582025-06-04T04:46:00.901ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1385, tv_nsec: 67077059 } })
7592025-06-04T04:46:00.902ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
7602025-06-04T04:46:00.903ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1385, tv_nsec: 68291178 } })
7612025-06-04T04:46:00.903ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
7622025-06-04T04:46:00.904ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7632025-06-04T04:46:00.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7642025-06-04T04:46:00.904ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7652025-06-04T04:46:00.905ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 9.726948ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
7662025-06-04T04:46:00.906ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7672025-06-04T04:46:00.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7682025-06-04T04:46:00.908ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7692025-06-04T04:46:00.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
7702025-06-04T04:46:00.908ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7712025-06-04T04:46:00.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7722025-06-04T04:46:00.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7732025-06-04T04:46:00.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
7742025-06-04T04:46:00.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7752025-06-04T04:46:00.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7762025-06-04T04:46:00.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
7772025-06-04T04:46:00.909ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7782025-06-04T04:46:00.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7792025-06-04T04:46:00.911ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7802025-06-04T04:46:00.911ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7812025-06-04T04:46:00.912ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7822025-06-04T04:46:00.912ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
7832025-06-04T04:46:00.912ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7842025-06-04T04:46:00.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7852025-06-04T04:46:00.912ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7862025-06-04T04:46:00.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7872025-06-04T04:46:00.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
7882025-06-04T04:46:00.913ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7892025-06-04T04:46:00.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7902025-06-04T04:46:00.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
7912025-06-04T04:46:00.914ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7922025-06-04T04:46:00.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7932025-06-04T04:46:00.918ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7942025-06-04T04:46:00.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7952025-06-04T04:46:00.918ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7962025-06-04T04:46:00.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7972025-06-04T04:46:00.919ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7982025-06-04T04:46:00.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7992025-06-04T04:46:00.925ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1385, tv_nsec: 91270497 } })
8002025-06-04T04:46:00.926ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36
8012025-06-04T04:46:00.933ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8022025-06-04T04:46:00.937ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1dd88a28-32c4-4490-89f2-ae05402d904c, lookup_type: ById(1dd88a28-32c4-4490-89f2-ae05402d904c) } result = Ok(())
8032025-06-04T04:46:00.938ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8042025-06-04T04:46:00.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8052025-06-04T04:46:00.961ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8062025-06-04T04:46:00.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8072025-06-04T04:46:00.963ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c original_time_created = 2025-06-04 04:36:14.609521 UTC target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c time_created = 2025-06-04 04:36:14.609521 UTC
8082025-06-04T04:46:00.963ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 67.792069ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","time_created":"2025-06-04T04:36:14.609521Z"}
8092025-06-04T04:46:00.964ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
8102025-06-04T04:46:00.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
8112025-06-04T04:46:00.965ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 69.17798ms iteration = 20 status = {"errors":[],"requests_created_ok":[]}
8122025-06-04T04:46:00.970ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8132025-06-04T04:46:00.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8142025-06-04T04:46:00.972ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8152025-06-04T04:46:00.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8162025-06-04T04:46:00.973ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
8172025-06-04T04:46:00.973ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8182025-06-04T04:46:00.973ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "287d29d6-dab7-406d-a3ad-9ad644dd9c34", "content-length": "26", "date": "Wed, 04 Jun 2025 04:46:00 GMT"} })
8192025-06-04T04:46:00.973ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8202025-06-04T04:46:00.975ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8212025-06-04T04:46:00.975ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8222025-06-04T04:46:00.976ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8232025-06-04T04:46:00.976ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
8242025-06-04T04:46:00.976ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8252025-06-04T04:46:00.977ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3fc05e3d-c2d6-46a8-835a-18995e5b2535", "content-length": "26", "date": "Wed, 04 Jun 2025 04:46:00 GMT"} })
8262025-06-04T04:46:00.977ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8272025-06-04T04:46:00.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cb8aa4e2-773a-4f3e-86b7-f32104e9c4de, lookup_type: ById(cb8aa4e2-773a-4f3e-86b7-f32104e9c4de) } result = Ok(())
8282025-06-04T04:46:00.978ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8292025-06-04T04:46:00.978ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8302025-06-04T04:46:00.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8312025-06-04T04:46:00.979ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
8322025-06-04T04:46:00.979ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8332025-06-04T04:46:00.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8342025-06-04T04:46:00.979ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 82.894988ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
8352025-06-04T04:46:00.981ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8362025-06-04T04:46:00.981ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 86.430722ms iteration = 20 status = 0
8372025-06-04T04:46:00.982ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
8382025-06-04T04:46:00.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
8392025-06-04T04:46:00.983ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
8402025-06-04T04:46:00.983ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8412025-06-04T04:46:00.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8422025-06-04T04:46:00.987ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8432025-06-04T04:46:00.987ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
8442025-06-04T04:46:00.987ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8452025-06-04T04:46:00.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8462025-06-04T04:46:00.987ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 92.389992ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8472025-06-04T04:46:00.988ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 91.940676ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
8482025-06-04T04:46:00.989ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
8492025-06-04T04:46:00.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
8502025-06-04T04:46:00.990ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
8512025-06-04T04:46:00.990ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 95.014182ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
8522025-06-04T04:46:00.991ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8532025-06-04T04:46:00.994ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
8542025-06-04T04:46:00.994ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
8552025-06-04T04:46:00.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
8562025-06-04T04:46:00.996ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8572025-06-04T04:46:00.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8582025-06-04T04:46:00.999ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8592025-06-04T04:46:00.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8602025-06-04T04:46:01.015ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8612025-06-04T04:46:01.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8622025-06-04T04:46:01.018ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 123.625417ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
8632025-06-04T04:46:01.044ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 zone_address = fd00:1122:3344:101::2
8642025-06-04T04:46:01.044ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8652025-06-04T04:46:01.044ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5581104d-6bf7-4c75-90d7-32394dedb071", "content-length": "26", "date": "Wed, 04 Jun 2025 04:46:00 GMT"} })
8662025-06-04T04:46:01.044ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8672025-06-04T04:46:01.045ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 147.959546ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
8682025-06-04T04:46:01.046ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36
8692025-06-04T04:46:01.055ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8702025-06-04T04:46:01.055ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
8712025-06-04T04:46:01.055ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 160.137401ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
8722025-06-04T04:46:01.077ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 183.151789ms iteration = 20 status = {}
8732025-06-04T04:46:01.080ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8742025-06-04T04:46:01.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8752025-06-04T04:46:01.084ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
8762025-06-04T04:46:01.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
8772025-06-04T04:46:01.093ZINFOnexus (BackgroundTasks): VPC route manager sled cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
8782025-06-04T04:46:01.093ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8792025-06-04T04:46:01.093ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0e32135-6012-48c4-880b-9207f68ff3c9", "content-length": "372", "date": "Wed, 04 Jun 2025 04:46:00 GMT"} })
8802025-06-04T04:46:01.093ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8812025-06-04T04:46:01.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8822025-06-04T04:46:01.095ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
8832025-06-04T04:46:01.095ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 200.27444ms iteration = 20 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
8842025-06-04T04:46:01.097ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 203.335546ms iteration = 20 status = null
8852025-06-04T04:46:01.139ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 243.087199ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
8862025-06-04T04:46:01.151ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 256.144307ms iteration = 22 status = {"physical_disks_added":0}
8872025-06-04T04:46:01.157ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
8882025-06-04T04:46:01.157ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
8892025-06-04T04:46:01.187ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8902025-06-04T04:46:01.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8912025-06-04T04:46:01.189ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: a0769b7e-afb1-46f8-b225-eac4dddfaf8d, rack_id: 5a147cfa-15ac-4bf0-8777-c82b354c8c36, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(913c54af-e122-4277-b509-f8a495f24eae) } rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch_location = Switch0
8922025-06-04T04:46:01.189ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8932025-06-04T04:46:01.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8942025-06-04T04:46:01.200ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
8952025-06-04T04:46:01.200ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 913c54af-e122-4277-b509-f8a495f24eae
8962025-06-04T04:46:01.200ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8972025-06-04T04:46:01.200ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8982025-06-04T04:46:01.200ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8992025-06-04T04:46:01.200ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9002025-06-04T04:46:01.200ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9012025-06-04T04:46:01.200ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
9022025-06-04T04:46:01.200ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9032025-06-04T04:46:01.200ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
9042025-06-04T04:46:01.200ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36
9052025-06-04T04:46:01.200ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9062025-06-04T04:46:01.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9072025-06-04T04:46:01.203ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch_location = Switch0
9082025-06-04T04:46:01.203ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
9092025-06-04T04:46:01.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 9a9b63bb-f9f3-4b2a-a604-89d7c452536d roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9102025-06-04T04:46:01.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 9a9b63bb-f9f3-4b2a-a604-89d7c452536d resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9112025-06-04T04:46:01.220ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "318bd7ee-90b9-48d2-bbbd-b75b75dd7ffd", "date": "Wed, 04 Jun 2025 04:46:01 GMT"} })
9122025-06-04T04:46:01.220ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9132025-06-04T04:46:01.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9142025-06-04T04:46:01.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2083 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 9a9b63bb-f9f3-4b2a-a604-89d7c452536d response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9152025-06-04T04:46:01.222ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9162025-06-04T04:46:01.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9172025-06-04T04:46:01.226ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9182025-06-04T04:46:01.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9192025-06-04T04:46:01.226ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9202025-06-04T04:46:01.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9212025-06-04T04:46:01.228ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9222025-06-04T04:46:01.229ZINFOnexus (BackgroundTasks): VPC route manager sled cb8aa4e2-773a-4f3e-86b7-f32104e9c4de push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
9232025-06-04T04:46:01.229ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9242025-06-04T04:46:01.230ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f56dc75a-ee6d-4784-85a2-1f970f40d713", "date": "Wed, 04 Jun 2025 04:46:01 GMT"} })
9252025-06-04T04:46:01.230ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9262025-06-04T04:46:01.230ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9272025-06-04T04:46:01.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9282025-06-04T04:46:01.231ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 336.379695ms iteration = 20 status = {}
9292025-06-04T04:46:01.232ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9302025-06-04T04:46:01.234ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9312025-06-04T04:46:01.234ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9322025-06-04T04:46:01.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9332025-06-04T04:46:01.267ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
9342025-06-04T04:46:01.267ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "202caf70-d030-43ee-b1ee-a64350c3adcf", "content-length": "691", "date": "Wed, 04 Jun 2025 04:46:01 GMT"} })
9352025-06-04T04:46:01.268ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
9362025-06-04T04:46:01.268ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
9372025-06-04T04:46:01.268ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
9382025-06-04T04:46:01.268ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 373.364786ms iteration = 20 status = {}
9392025-06-04T04:46:01.320ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "16e3d7e2-c0fc-4a7b-9951-0831f11f9fff", "date": "Wed, 04 Jun 2025 04:46:01 GMT"} })
9402025-06-04T04:46:01.320ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch = Switch0
9412025-06-04T04:46:01.320ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
9422025-06-04T04:46:01.324ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e3cdb65-85a8-4064-be4c-a0876ed24d01", "content-length": "682", "date": "Wed, 04 Jun 2025 04:46:01 GMT"} })
9432025-06-04T04:46:01.324ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9442025-06-04T04:46:01.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9452025-06-04T04:46:01.328ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9462025-06-04T04:46:01.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9472025-06-04T04:46:01.332ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9482025-06-04T04:46:01.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9492025-06-04T04:46:01.334ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9502025-06-04T04:46:01.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9512025-06-04T04:46:01.341ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 445.845347ms iteration = 20 status = {}
9522025-06-04T04:46:01.492ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:46293
9532025-06-04T04:46:01.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46293 req_id = 0c84f2bb-fbb7-442b-8029-2f64b48866c2 roles = RoleSet { roles: {} } uri = /metrics/collectors/6e958f0b-8d3a-47ee-bfea-40bd8f174cf7/producers?sort_by=id_ascending
9542025-06-04T04:46:01.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46293 req_id = 0c84f2bb-fbb7-442b-8029-2f64b48866c2 resource = Database result = Ok(()) uri = /metrics/collectors/6e958f0b-8d3a-47ee-bfea-40bd8f174cf7/producers?sort_by=id_ascending
9552025-06-04T04:46:01.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46293 req_id = 0c84f2bb-fbb7-442b-8029-2f64b48866c2 response_code = 200 uri = /metrics/collectors/6e958f0b-8d3a-47ee-bfea-40bd8f174cf7/producers?sort_by=id_ascending
9562025-06-04T04:46:01.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46293 req_id = 34ff401a-d3e5-4e00-9739-306b08c20f60 roles = RoleSet { roles: {} } uri = /metrics/collectors/6e958f0b-8d3a-47ee-bfea-40bd8f174cf7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjAzODE5NC0yMDU3LTQ0NmYtOGM2ZS04YjA1YWFlODk3NWQifX0%3D
9572025-06-04T04:46:01.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46293 req_id = 34ff401a-d3e5-4e00-9739-306b08c20f60 resource = Database result = Ok(()) uri = /metrics/collectors/6e958f0b-8d3a-47ee-bfea-40bd8f174cf7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjAzODE5NC0yMDU3LTQ0NmYtOGM2ZS04YjA1YWFlODk3NWQifX0%3D
9582025-06-04T04:46:01.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46293 req_id = 34ff401a-d3e5-4e00-9739-306b08c20f60 response_code = 200 uri = /metrics/collectors/6e958f0b-8d3a-47ee-bfea-40bd8f174cf7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjAzODE5NC0yMDU3LTQ0NmYtOGM2ZS04YjA1YWFlODk3NWQifX0%3D
9592025-06-04T04:46:02.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 37987cc7-c4ae-4e36-a007-befdd47904dd roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9602025-06-04T04:46:02.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 37987cc7-c4ae-4e36-a007-befdd47904dd resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9612025-06-04T04:46:02.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1915 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 37987cc7-c4ae-4e36-a007-befdd47904dd response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9622025-06-04T04:46:03.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 319cd505-4c50-4b22-8cfe-d3db89c1b11e roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9632025-06-04T04:46:03.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 319cd505-4c50-4b22-8cfe-d3db89c1b11e resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9642025-06-04T04:46:03.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2339 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 319cd505-4c50-4b22-8cfe-d3db89c1b11e response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9652025-06-04T04:46:04.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 945be04c-107b-49af-8c88-87daf45a68eb roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9662025-06-04T04:46:04.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 945be04c-107b-49af-8c88-87daf45a68eb resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9672025-06-04T04:46:04.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2118 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 945be04c-107b-49af-8c88-87daf45a68eb response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9682025-06-04T04:46:05.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 35d3eb30-6e14-4142-808b-85025f2b664d roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9692025-06-04T04:46:05.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 35d3eb30-6e14-4142-808b-85025f2b664d resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9702025-06-04T04:46:05.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2405 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 35d3eb30-6e14-4142-808b-85025f2b664d response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9712025-06-04T04:46:06.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3b26ff9b-50ae-442b-826d-859b57b4fb31 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9722025-06-04T04:46:06.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3b26ff9b-50ae-442b-826d-859b57b4fb31 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9732025-06-04T04:46:06.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2056 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3b26ff9b-50ae-442b-826d-859b57b4fb31 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9742025-06-04T04:46:06.505ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 773 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = 90bcff86-d44f-46f4-998d-645f8692c759 response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
9752025-06-04T04:46:07.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f127fff7-dfaf-427d-b670-4440eea9b20a roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9762025-06-04T04:46:07.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f127fff7-dfaf-427d-b670-4440eea9b20a resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9772025-06-04T04:46:07.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1877 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f127fff7-dfaf-427d-b670-4440eea9b20a response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9782025-06-04T04:46:08.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 060e49c7-bbbf-4c72-9d31-926d97c8694b roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9792025-06-04T04:46:08.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 060e49c7-bbbf-4c72-9d31-926d97c8694b resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9802025-06-04T04:46:08.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2345 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 060e49c7-bbbf-4c72-9d31-926d97c8694b response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9812025-06-04T04:46:09.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 9cd0b199-b2e2-46da-94cf-5afdfb410759 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9822025-06-04T04:46:09.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 9cd0b199-b2e2-46da-94cf-5afdfb410759 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9832025-06-04T04:46:09.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2465 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 9cd0b199-b2e2-46da-94cf-5afdfb410759 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9842025-06-04T04:46:10.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 581dc2bb-6393-49ca-82cb-6132b45eab0b roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9852025-06-04T04:46:10.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 581dc2bb-6393-49ca-82cb-6132b45eab0b resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9862025-06-04T04:46:10.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2505 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 581dc2bb-6393-49ca-82cb-6132b45eab0b response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
9872025-06-04T04:46:10.894ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
9882025-06-04T04:46:10.894ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9892025-06-04T04:46:10.894ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
9902025-06-04T04:46:10.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9912025-06-04T04:46:10.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9922025-06-04T04:46:10.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9932025-06-04T04:46:10.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9942025-06-04T04:46:10.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9952025-06-04T04:46:10.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9962025-06-04T04:46:10.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9972025-06-04T04:46:10.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9982025-06-04T04:46:10.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9992025-06-04T04:46:10.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10002025-06-04T04:46:10.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1dd88a28-32c4-4490-89f2-ae05402d904c, lookup_type: ById(1dd88a28-32c4-4490-89f2-ae05402d904c) } result = Ok(())
10012025-06-04T04:46:10.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10022025-06-04T04:46:10.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10032025-06-04T04:46:10.921ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c original_time_created = 2025-06-04 04:36:14.609521 UTC target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c time_created = 2025-06-04 04:36:14.609521 UTC
10042025-06-04T04:46:10.921ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.01716ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","time_created":"2025-06-04T04:36:14.609521Z"}
10052025-06-04T04:46:10.937ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10062025-06-04T04:46:10.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10072025-06-04T04:46:10.970ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 75.370894ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10082025-06-04T04:46:11.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f431dc85-0a32-4720-b723-7ad52da851a5 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10092025-06-04T04:46:11.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f431dc85-0a32-4720-b723-7ad52da851a5 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10102025-06-04T04:46:11.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1478 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f431dc85-0a32-4720-b723-7ad52da851a5 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10112025-06-04T04:46:12.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3cb958fc-5216-4642-bf49-7f73d3074406 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10122025-06-04T04:46:12.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3cb958fc-5216-4642-bf49-7f73d3074406 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10132025-06-04T04:46:12.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3cb958fc-5216-4642-bf49-7f73d3074406 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10142025-06-04T04:46:13.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 8c31e866-bf65-4f42-86c3-3d36daefc92b roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10152025-06-04T04:46:13.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 8c31e866-bf65-4f42-86c3-3d36daefc92b resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10162025-06-04T04:46:13.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2127 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 8c31e866-bf65-4f42-86c3-3d36daefc92b response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10172025-06-04T04:46:14.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 20e3ea14-aa0e-49ee-8ab9-ac4cf4a8f892 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10182025-06-04T04:46:14.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 20e3ea14-aa0e-49ee-8ab9-ac4cf4a8f892 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10192025-06-04T04:46:14.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2237 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 20e3ea14-aa0e-49ee-8ab9-ac4cf4a8f892 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10202025-06-04T04:46:15.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 46b3be4a-0fb9-4f27-9a98-3ab898b9dfed roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10212025-06-04T04:46:15.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 46b3be4a-0fb9-4f27-9a98-3ab898b9dfed resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10222025-06-04T04:46:15.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2452 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 46b3be4a-0fb9-4f27-9a98-3ab898b9dfed response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10232025-06-04T04:46:16.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c6b6f017-6616-4e8c-8b86-0761361e78a8 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10242025-06-04T04:46:16.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c6b6f017-6616-4e8c-8b86-0761361e78a8 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10252025-06-04T04:46:16.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1872 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c6b6f017-6616-4e8c-8b86-0761361e78a8 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10262025-06-04T04:46:16.505ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 762 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = d678ad4e-9882-4680-af89-3f27a3e2bb06 response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
10272025-06-04T04:46:17.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 56791058-b4ba-458c-b056-6b3cada4da36 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10282025-06-04T04:46:17.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 56791058-b4ba-458c-b056-6b3cada4da36 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10292025-06-04T04:46:17.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2584 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 56791058-b4ba-458c-b056-6b3cada4da36 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10302025-06-04T04:46:18.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 01c5ee99-2be9-4a14-bac3-701ca3cbb4eb roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10312025-06-04T04:46:18.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 01c5ee99-2be9-4a14-bac3-701ca3cbb4eb resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10322025-06-04T04:46:18.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 01c5ee99-2be9-4a14-bac3-701ca3cbb4eb response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10332025-06-04T04:46:19.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = fa83e22d-a2fd-4d34-b4f3-2a8267a2bbba roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10342025-06-04T04:46:19.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = fa83e22d-a2fd-4d34-b4f3-2a8267a2bbba resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10352025-06-04T04:46:19.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2349 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = fa83e22d-a2fd-4d34-b4f3-2a8267a2bbba response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10362025-06-04T04:46:20.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 0c2d1755-1198-44dd-9e61-556e90b4ddde roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10372025-06-04T04:46:20.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 0c2d1755-1198-44dd-9e61-556e90b4ddde resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10382025-06-04T04:46:20.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1943 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 0c2d1755-1198-44dd-9e61-556e90b4ddde response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10392025-06-04T04:46:20.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
10402025-06-04T04:46:20.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10412025-06-04T04:46:20.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
10422025-06-04T04:46:20.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10432025-06-04T04:46:20.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10442025-06-04T04:46:20.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10452025-06-04T04:46:20.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10462025-06-04T04:46:20.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10472025-06-04T04:46:20.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10482025-06-04T04:46:20.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10492025-06-04T04:46:20.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10502025-06-04T04:46:20.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10512025-06-04T04:46:20.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10522025-06-04T04:46:20.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1dd88a28-32c4-4490-89f2-ae05402d904c, lookup_type: ById(1dd88a28-32c4-4490-89f2-ae05402d904c) } result = Ok(())
10532025-06-04T04:46:20.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10542025-06-04T04:46:20.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10552025-06-04T04:46:20.917ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c original_time_created = 2025-06-04 04:36:14.609521 UTC target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c time_created = 2025-06-04 04:36:14.609521 UTC
10562025-06-04T04:46:20.917ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.174597ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","time_created":"2025-06-04T04:36:14.609521Z"}
10572025-06-04T04:46:20.934ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10582025-06-04T04:46:20.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10592025-06-04T04:46:20.936ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.582806ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10602025-06-04T04:46:21.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = b0d97aa9-dd1e-4e9f-812f-2e45b97c8203 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10612025-06-04T04:46:21.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = b0d97aa9-dd1e-4e9f-812f-2e45b97c8203 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10622025-06-04T04:46:21.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2022 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = b0d97aa9-dd1e-4e9f-812f-2e45b97c8203 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10632025-06-04T04:46:22.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 6dcb6a02-789e-41d5-b31c-2addbb8984d1 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10642025-06-04T04:46:22.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 6dcb6a02-789e-41d5-b31c-2addbb8984d1 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10652025-06-04T04:46:22.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2038 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 6dcb6a02-789e-41d5-b31c-2addbb8984d1 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10662025-06-04T04:46:23.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 689e096a-35f5-4aa8-ad8c-fbcd0ff08500 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10672025-06-04T04:46:23.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 689e096a-35f5-4aa8-ad8c-fbcd0ff08500 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10682025-06-04T04:46:23.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2401 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 689e096a-35f5-4aa8-ad8c-fbcd0ff08500 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10692025-06-04T04:46:24.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5b1f8058-8211-4c9b-ad81-074aaa49b286 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10702025-06-04T04:46:24.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5b1f8058-8211-4c9b-ad81-074aaa49b286 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10712025-06-04T04:46:24.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2157 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5b1f8058-8211-4c9b-ad81-074aaa49b286 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10722025-06-04T04:46:25.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f2e0a8cd-d2db-45fa-ac42-9d60c5366fa2 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10732025-06-04T04:46:25.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f2e0a8cd-d2db-45fa-ac42-9d60c5366fa2 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10742025-06-04T04:46:25.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1786 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f2e0a8cd-d2db-45fa-ac42-9d60c5366fa2 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10752025-06-04T04:46:26.504ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 591 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = 16f7f6c2-5e7d-4b37-9970-074221c8ce88 response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
10762025-06-04T04:46:26.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f4a1d185-81c9-489f-973b-b406cbf3db4c roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10772025-06-04T04:46:26.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f4a1d185-81c9-489f-973b-b406cbf3db4c resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10782025-06-04T04:46:26.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2270 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f4a1d185-81c9-489f-973b-b406cbf3db4c response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10792025-06-04T04:46:27.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 1e1b6fe6-565b-4507-b132-5c06291aca1d roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10802025-06-04T04:46:27.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 1e1b6fe6-565b-4507-b132-5c06291aca1d resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10812025-06-04T04:46:27.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 1e1b6fe6-565b-4507-b132-5c06291aca1d response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10822025-06-04T04:46:28.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = e21ed858-5fa6-4aeb-b227-4a58e06abc5f roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10832025-06-04T04:46:28.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = e21ed858-5fa6-4aeb-b227-4a58e06abc5f resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10842025-06-04T04:46:28.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = e21ed858-5fa6-4aeb-b227-4a58e06abc5f response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10852025-06-04T04:46:29.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 62993c21-a295-42ce-99b4-50efb24068a9 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10862025-06-04T04:46:29.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 62993c21-a295-42ce-99b4-50efb24068a9 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10872025-06-04T04:46:29.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2001 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 62993c21-a295-42ce-99b4-50efb24068a9 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10882025-06-04T04:46:30.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 328f8f05-1878-4640-9b3e-b6ab3764a435 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10892025-06-04T04:46:30.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 328f8f05-1878-4640-9b3e-b6ab3764a435 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10902025-06-04T04:46:30.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2683 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 328f8f05-1878-4640-9b3e-b6ab3764a435 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
10912025-06-04T04:46:30.894ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
10922025-06-04T04:46:30.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
10932025-06-04T04:46:30.894ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10942025-06-04T04:46:30.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
10952025-06-04T04:46:30.894ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
10962025-06-04T04:46:30.894ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10972025-06-04T04:46:30.894ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
10982025-06-04T04:46:30.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
10992025-06-04T04:46:30.894ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-06-04 04:36:30.894817453 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
11002025-06-04T04:46:30.894ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
11012025-06-04T04:46:30.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
11022025-06-04T04:46:30.894ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
11032025-06-04T04:46:30.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
11042025-06-04T04:46:30.894ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11052025-06-04T04:46:30.894ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
11062025-06-04T04:46:30.894ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
11072025-06-04T04:46:30.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
11082025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
11092025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11102025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
11112025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11122025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
11132025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
11142025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11152025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11162025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
11172025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
11182025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11192025-06-04T04:46:30.895ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
11202025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11212025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
11222025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
11232025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11242025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
11252025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11262025-06-04T04:46:30.895ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c
11272025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.36\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c"}
11282025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 5 reason = Timeout
11292025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
11302025-06-04T04:46:30.895ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
11312025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
11322025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11332025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
11342025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
11352025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
11362025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
11372025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11382025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
11392025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
11402025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
11412025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11422025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11432025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 21 reason = Timeout
11442025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
11452025-06-04T04:46:30.895ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
11462025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
11472025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
11482025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11492025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11502025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11512025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
11522025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11532025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
11542025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11552025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11562025-06-04T04:46:30.895ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6bd72d79-86a4-4394-904a-eda88bc21fd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("badd8271-e80d-44a0-993c-76a669a9eadb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f664b51a-ef20-45b7-9cac-a2aa17e449b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f664b51a-ef20-45b7-9cac-a2aa17e449b7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1415, tv_nsec: 60819517 } })
11572025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11582025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11592025-06-04T04:46:30.895ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3147fdc0-57b9-465b-97b1-724db3a98549.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fd2bb11e-a66c-4a76-9d9e-ddc3f90ca952.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fd2bb11e-a66c-4a76-9d9e-ddc3f90ca952.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1415, tv_nsec: 60884198 } })
11602025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
11612025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11622025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11632025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
11642025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11652025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11662025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
11672025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11682025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11692025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11702025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
11712025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
11722025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11732025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 11 reason = Timeout
11742025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 3 reason = Timeout
11752025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
11762025-06-04T04:46:30.895ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
11772025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
11782025-06-04T04:46:30.895ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
11792025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
11802025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
11812025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
11822025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
11832025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
11842025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
11852025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
11862025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
11872025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
11882025-06-04T04:46:30.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
11892025-06-04T04:46:30.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11902025-06-04T04:46:30.896ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 11 reason = Timeout
11912025-06-04T04:46:30.896ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
11922025-06-04T04:46:30.896ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 21 reason = Timeout
11932025-06-04T04:46:30.896ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
11942025-06-04T04:46:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
11952025-06-04T04:46:30.896ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
11962025-06-04T04:46:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
11972025-06-04T04:46:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
11982025-06-04T04:46:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
11992025-06-04T04:46:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
12002025-06-04T04:46:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
12012025-06-04T04:46:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
12022025-06-04T04:46:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
12032025-06-04T04:46:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
12042025-06-04T04:46:30.896ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
12052025-06-04T04:46:30.896ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.520733ms iteration = 11 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
12062025-06-04T04:46:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12072025-06-04T04:46:30.896ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
12082025-06-04T04:46:30.896ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.639825ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
12092025-06-04T04:46:30.897ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12102025-06-04T04:46:30.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12112025-06-04T04:46:30.897ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1415, tv_nsec: 62728626 } })
12122025-06-04T04:46:30.897ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
12132025-06-04T04:46:30.897ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12142025-06-04T04:46:30.897ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.711792ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
12152025-06-04T04:46:30.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12162025-06-04T04:46:30.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12172025-06-04T04:46:30.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12182025-06-04T04:46:30.900ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1415, tv_nsec: 65576059 } })
12192025-06-04T04:46:30.900ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
12202025-06-04T04:46:30.901ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-06-04 04:36:30.894817453 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
12212025-06-04T04:46:30.901ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.406177ms iteration = 11 status = {"expiration":"2025-06-04T04:36:30.894817453Z","pruned":[]}
12222025-06-04T04:46:30.901ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12232025-06-04T04:46:30.901ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12242025-06-04T04:46:30.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12252025-06-04T04:46:30.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12262025-06-04T04:46:30.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
12272025-06-04T04:46:30.904ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12282025-06-04T04:46:30.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12292025-06-04T04:46:30.905ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
12302025-06-04T04:46:30.905ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12312025-06-04T04:46:30.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12322025-06-04T04:46:30.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
12332025-06-04T04:46:30.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12342025-06-04T04:46:30.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
12352025-06-04T04:46:30.906ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
12362025-06-04T04:46:30.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12372025-06-04T04:46:30.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
12382025-06-04T04:46:30.907ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12392025-06-04T04:46:30.908ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12402025-06-04T04:46:30.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12412025-06-04T04:46:30.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
12422025-06-04T04:46:30.909ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
12432025-06-04T04:46:30.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
12442025-06-04T04:46:30.911ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12452025-06-04T04:46:30.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12462025-06-04T04:46:30.912ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12472025-06-04T04:46:30.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12482025-06-04T04:46:30.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12492025-06-04T04:46:30.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12502025-06-04T04:46:30.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12512025-06-04T04:46:30.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
12522025-06-04T04:46:30.912ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12532025-06-04T04:46:30.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12542025-06-04T04:46:30.914ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12552025-06-04T04:46:30.914ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12562025-06-04T04:46:30.914ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
12572025-06-04T04:46:30.914ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12582025-06-04T04:46:30.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12592025-06-04T04:46:30.916ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12602025-06-04T04:46:30.916ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
12612025-06-04T04:46:30.916ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 20.569302ms iteration = 11 status = {"by_rx":{},"error":null}
12622025-06-04T04:46:30.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
12632025-06-04T04:46:30.916ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
12642025-06-04T04:46:30.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
12652025-06-04T04:46:30.918ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
12662025-06-04T04:46:30.918ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
12672025-06-04T04:46:30.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
12682025-06-04T04:46:30.919ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 23.605308ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
12692025-06-04T04:46:30.922ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 26.563963ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
12702025-06-04T04:46:30.925ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12712025-06-04T04:46:30.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12722025-06-04T04:46:30.926ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12732025-06-04T04:46:30.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12742025-06-04T04:46:30.927ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1415, tv_nsec: 92382236 } })
12752025-06-04T04:46:30.927ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36
12762025-06-04T04:46:30.929ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12772025-06-04T04:46:30.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12782025-06-04T04:46:30.931ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12792025-06-04T04:46:30.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12802025-06-04T04:46:30.936ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12812025-06-04T04:46:30.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12822025-06-04T04:46:30.939ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12832025-06-04T04:46:30.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12842025-06-04T04:46:30.941ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12852025-06-04T04:46:30.945ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
12862025-06-04T04:46:30.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
12872025-06-04T04:46:30.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
12882025-06-04T04:46:30.949ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12892025-06-04T04:46:30.949ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
12902025-06-04T04:46:30.949ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12912025-06-04T04:46:30.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12922025-06-04T04:46:30.952ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12932025-06-04T04:46:30.955ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12942025-06-04T04:46:30.955ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12952025-06-04T04:46:30.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12962025-06-04T04:46:30.958ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12972025-06-04T04:46:30.960ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
12982025-06-04T04:46:30.960ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
12992025-06-04T04:46:30.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
13002025-06-04T04:46:30.962ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13012025-06-04T04:46:30.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13022025-06-04T04:46:30.965ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13032025-06-04T04:46:30.966ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13042025-06-04T04:46:30.966ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
13052025-06-04T04:46:30.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
13062025-06-04T04:46:30.967ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13072025-06-04T04:46:30.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13082025-06-04T04:46:30.968ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13092025-06-04T04:46:30.968ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13102025-06-04T04:46:30.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13112025-06-04T04:46:30.969ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
13122025-06-04T04:46:30.969ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13132025-06-04T04:46:30.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13142025-06-04T04:46:30.970ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13152025-06-04T04:46:30.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13162025-06-04T04:46:30.971ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13172025-06-04T04:46:30.972ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
13182025-06-04T04:46:30.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
13192025-06-04T04:46:30.974ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13202025-06-04T04:46:30.974ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13212025-06-04T04:46:30.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13222025-06-04T04:46:30.975ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13232025-06-04T04:46:30.975ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
13242025-06-04T04:46:30.975ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 80.948598ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
13252025-06-04T04:46:30.977ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
13262025-06-04T04:46:30.977ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
13272025-06-04T04:46:30.977ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 81.257994ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
13282025-06-04T04:46:30.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13292025-06-04T04:46:30.981ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13302025-06-04T04:46:30.982ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 86.709596ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
13312025-06-04T04:46:30.984ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 90.037737ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13322025-06-04T04:46:30.985ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
13332025-06-04T04:46:30.985ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
13342025-06-04T04:46:30.985ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 90.077807ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
13352025-06-04T04:46:30.985ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13362025-06-04T04:46:30.986ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13372025-06-04T04:46:30.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13382025-06-04T04:46:30.986ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
13392025-06-04T04:46:30.986ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
13402025-06-04T04:46:30.986ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
13412025-06-04T04:46:30.986ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13422025-06-04T04:46:30.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13432025-06-04T04:46:30.988ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13442025-06-04T04:46:30.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13452025-06-04T04:46:30.988ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 92.471113ms iteration = 11 status = {"dispatched":[],"errors":[],"glob_version":"146.0.0","globs_reprocessed":{},"no_receivers":[]}
13462025-06-04T04:46:30.988ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 92.949701ms iteration = 21 status = {"errors":[],"requests_created_ok":[]}
13472025-06-04T04:46:30.989ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13482025-06-04T04:46:30.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13492025-06-04T04:46:30.990ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 95.119563ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
13502025-06-04T04:46:30.997ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13512025-06-04T04:46:30.999ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13522025-06-04T04:46:31.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13532025-06-04T04:46:31.001ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13542025-06-04T04:46:31.002ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13552025-06-04T04:46:31.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13562025-06-04T04:46:31.002ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13572025-06-04T04:46:31.008ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
13582025-06-04T04:46:31.008ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13592025-06-04T04:46:31.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13602025-06-04T04:46:31.011ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13612025-06-04T04:46:31.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13622025-06-04T04:46:31.013ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13632025-06-04T04:46:31.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13642025-06-04T04:46:31.016ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13652025-06-04T04:46:31.017ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13662025-06-04T04:46:31.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
13672025-06-04T04:46:31.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
13682025-06-04T04:46:31.021ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13692025-06-04T04:46:31.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13702025-06-04T04:46:31.023ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13712025-06-04T04:46:31.025ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13722025-06-04T04:46:31.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13732025-06-04T04:46:31.026ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
13742025-06-04T04:46:31.026ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13752025-06-04T04:46:31.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
13762025-06-04T04:46:31.026ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13772025-06-04T04:46:31.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13782025-06-04T04:46:31.027ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13792025-06-04T04:46:31.027ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
13802025-06-04T04:46:31.028ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 132.836496ms iteration = 21 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
13812025-06-04T04:46:31.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13822025-06-04T04:46:31.029ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13832025-06-04T04:46:31.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13842025-06-04T04:46:31.030ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13852025-06-04T04:46:31.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13862025-06-04T04:46:31.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13872025-06-04T04:46:31.031ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13882025-06-04T04:46:31.031ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13892025-06-04T04:46:31.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13902025-06-04T04:46:31.033ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13912025-06-04T04:46:31.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
13922025-06-04T04:46:31.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
13932025-06-04T04:46:31.033ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13942025-06-04T04:46:31.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13952025-06-04T04:46:31.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1dd88a28-32c4-4490-89f2-ae05402d904c, lookup_type: ById(1dd88a28-32c4-4490-89f2-ae05402d904c) } result = Ok(())
13962025-06-04T04:46:31.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13972025-06-04T04:46:31.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13982025-06-04T04:46:31.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cb8aa4e2-773a-4f3e-86b7-f32104e9c4de, lookup_type: ById(cb8aa4e2-773a-4f3e-86b7-f32104e9c4de) } result = Ok(())
13992025-06-04T04:46:31.035ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14002025-06-04T04:46:31.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14012025-06-04T04:46:31.035ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14022025-06-04T04:46:31.035ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14032025-06-04T04:46:31.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14042025-06-04T04:46:31.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14052025-06-04T04:46:31.037ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14062025-06-04T04:46:31.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14072025-06-04T04:46:31.038ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14082025-06-04T04:46:31.038ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
14092025-06-04T04:46:31.038ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 143.600629ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
14102025-06-04T04:46:31.039ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 144.043136ms iteration = 21 status = 0
14112025-06-04T04:46:31.039ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 144.498693ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
14122025-06-04T04:46:31.039ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
14132025-06-04T04:46:31.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
14142025-06-04T04:46:31.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
14152025-06-04T04:46:31.041ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
14162025-06-04T04:46:31.041ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
14172025-06-04T04:46:31.041ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
14182025-06-04T04:46:31.041ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14192025-06-04T04:46:31.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14202025-06-04T04:46:31.041ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14212025-06-04T04:46:31.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14222025-06-04T04:46:31.042ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14232025-06-04T04:46:31.045ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14242025-06-04T04:46:31.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14252025-06-04T04:46:31.045ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
14262025-06-04T04:46:31.045ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
14272025-06-04T04:46:31.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
14282025-06-04T04:46:31.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
14292025-06-04T04:46:31.047ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14302025-06-04T04:46:31.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
14312025-06-04T04:46:31.047ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14322025-06-04T04:46:31.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14332025-06-04T04:46:31.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14342025-06-04T04:46:31.054ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
14352025-06-04T04:46:31.054ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 787b83fc-6b83-4eec-b3a2-7c7c59871d86 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
14362025-06-04T04:46:31.054ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14372025-06-04T04:46:31.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14382025-06-04T04:46:31.054ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c original_time_created = 2025-06-04 04:36:14.609521 UTC target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c time_created = 2025-06-04 04:36:14.609521 UTC
14392025-06-04T04:46:31.054ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 159.379479ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","time_created":"2025-06-04T04:36:14.609521Z"}
14402025-06-04T04:46:31.054ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14412025-06-04T04:46:31.056ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14422025-06-04T04:46:31.056ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14432025-06-04T04:46:31.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14442025-06-04T04:46:31.056ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 161.072685ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
14452025-06-04T04:46:31.061ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
14462025-06-04T04:46:31.061ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14472025-06-04T04:46:31.061ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec45f789-31d6-41a5-a84a-7db49d4c228d", "content-length": "26", "date": "Wed, 04 Jun 2025 04:46:31 GMT"} })
14482025-06-04T04:46:31.061ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14492025-06-04T04:46:31.062ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
14502025-06-04T04:46:31.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
14512025-06-04T04:46:31.063ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14522025-06-04T04:46:31.069ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
14532025-06-04T04:46:31.069ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14542025-06-04T04:46:31.069ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f8ee930-7f3d-47a9-aff9-efeee5d72f64", "content-length": "26", "date": "Wed, 04 Jun 2025 04:46:31 GMT"} })
14552025-06-04T04:46:31.069ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14562025-06-04T04:46:31.071ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14572025-06-04T04:46:31.100ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
14582025-06-04T04:46:31.100ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 204.732847ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
14592025-06-04T04:46:31.114ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
14602025-06-04T04:46:31.123ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 228.041601ms iteration = 23 status = {"physical_disks_added":0}
14612025-06-04T04:46:31.157ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
14622025-06-04T04:46:31.265ZINFOnexus (BackgroundTasks): VPC route manager sled cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
14632025-06-04T04:46:31.265ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14642025-06-04T04:46:31.267ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "146a7a1d-ff2b-4a2b-8bde-9369832e214e", "content-length": "372", "date": "Wed, 04 Jun 2025 04:46:30 GMT"} })
14652025-06-04T04:46:31.267ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14662025-06-04T04:46:31.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14672025-06-04T04:46:31.268ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14682025-06-04T04:46:31.269ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
14692025-06-04T04:46:31.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
14702025-06-04T04:46:31.269ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14712025-06-04T04:46:31.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14722025-06-04T04:46:31.270ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14732025-06-04T04:46:31.270ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14742025-06-04T04:46:31.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14752025-06-04T04:46:31.272ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14762025-06-04T04:46:31.272ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14772025-06-04T04:46:31.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14782025-06-04T04:46:31.274ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
14792025-06-04T04:46:31.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
14802025-06-04T04:46:31.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
14812025-06-04T04:46:31.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14822025-06-04T04:46:31.278ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14832025-06-04T04:46:31.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14842025-06-04T04:46:31.279ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
14852025-06-04T04:46:31.279ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
14862025-06-04T04:46:31.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
14872025-06-04T04:46:31.282ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14882025-06-04T04:46:31.282ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
14892025-06-04T04:46:31.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14902025-06-04T04:46:31.282ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 387.520651ms iteration = 5 status = {"blueprint_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","inventory_collection_id":"f2a99db4-ab80-46a5-ba0f-1f049512aa20","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
14912025-06-04T04:46:31.284ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 zone_address = fd00:1122:3344:101::2
14922025-06-04T04:46:31.284ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14932025-06-04T04:46:31.284ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "66bd6604-a491-423c-97d9-91b823bf8fe0", "content-length": "26", "date": "Wed, 04 Jun 2025 04:46:31 GMT"} })
14942025-06-04T04:46:31.284ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14952025-06-04T04:46:31.284ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14962025-06-04T04:46:31.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14972025-06-04T04:46:31.286ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36
14982025-06-04T04:46:31.286ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14992025-06-04T04:46:31.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15002025-06-04T04:46:31.288ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15012025-06-04T04:46:31.294ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
15022025-06-04T04:46:31.294ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15032025-06-04T04:46:31.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15042025-06-04T04:46:31.299ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15052025-06-04T04:46:31.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15062025-06-04T04:46:31.301ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 406.094003ms iteration = 21 status = {}
15072025-06-04T04:46:31.301ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15082025-06-04T04:46:31.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15092025-06-04T04:46:31.303ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15102025-06-04T04:46:31.307ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
15112025-06-04T04:46:31.307ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15122025-06-04T04:46:31.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15132025-06-04T04:46:31.310ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15142025-06-04T04:46:31.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15152025-06-04T04:46:31.312ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 418.135786ms iteration = 21 status = null
15162025-06-04T04:46:31.317ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
15172025-06-04T04:46:31.317ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 422.533823ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
15182025-06-04T04:46:31.317ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15192025-06-04T04:46:31.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15202025-06-04T04:46:31.321ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
15212025-06-04T04:46:31.321ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
15222025-06-04T04:46:31.321ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ce77201a-6012-44b3-bdd1-aa82b5d93c9b dns_zone_name = oxide.test found_so_far = 0 version = 2
15232025-06-04T04:46:31.321ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15242025-06-04T04:46:31.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
15252025-06-04T04:46:31.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15262025-06-04T04:46:31.321ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15272025-06-04T04:46:31.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15282025-06-04T04:46:31.322ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15292025-06-04T04:46:31.323ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15302025-06-04T04:46:31.324ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15312025-06-04T04:46:31.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15322025-06-04T04:46:31.325ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
15332025-06-04T04:46:31.325ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
15342025-06-04T04:46:31.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
15352025-06-04T04:46:31.327ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15362025-06-04T04:46:31.329ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15372025-06-04T04:46:31.329ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15382025-06-04T04:46:31.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15392025-06-04T04:46:31.329ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-06-04T04:36:26.716717Z, time_modified: 2025-06-04T04:36:26.716717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 6ac9285f-aca7-426a-86f8-a677f8a85ac2, db_silo: Silo { identity: SiloIdentity { id: 6ac9285f-aca7-426a-86f8-a677f8a85ac2, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-04T04:36:32.675073Z, time_modified: 2025-06-04T04:36:32.675073Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "26b91f4e65966da67879de126c5f5f1398a4ef21b95a2113db132d6cfa56d902" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 6ac9285f-aca7-426a-86f8-a677f8a85ac2, db_silo: Silo { identity: SiloIdentity { id: 6ac9285f-aca7-426a-86f8-a677f8a85ac2, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-04T04:36:32.675073Z, time_modified: 2025-06-04T04:36:32.675073Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "26b91f4e65966da67879de126c5f5f1398a4ef21b95a2113db132d6cfa56d902" }] }) }
15402025-06-04T04:46:31.329ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 434.971113ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"6ac9285f-aca7-426a-86f8-a677f8a85ac2","tls_certs":["26b91f4e65966da67879de126c5f5f1398a4ef21b95a2113db132d6cfa56d902"]}},"default_endpoint":{"silo_id":"6ac9285f-aca7-426a-86f8-a677f8a85ac2","tls_certs":["26b91f4e65966da67879de126c5f5f1398a4ef21b95a2113db132d6cfa56d902"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
15412025-06-04T04:46:31.330ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15422025-06-04T04:46:31.330ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15432025-06-04T04:46:31.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15442025-06-04T04:46:31.331ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
15452025-06-04T04:46:31.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
15462025-06-04T04:46:31.332ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15472025-06-04T04:46:31.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15482025-06-04T04:46:31.332ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ce77201a-6012-44b3-bdd1-aa82b5d93c9b dns_zone_name = oxide.test found_so_far = 4 version = 2
15492025-06-04T04:46:31.332ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
15502025-06-04T04:46:31.332ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-06-04 04:36:32.761780 UTC dns_group = external generation = 2
15512025-06-04T04:46:31.332ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 437.575142ms iteration = 11 status = {"generation":2}
15522025-06-04T04:46:31.332ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 787b83fc-6b83-4eec-b3a2-7c7c59871d86 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
15532025-06-04T04:46:31.332ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
15542025-06-04T04:46:31.332ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-06-04 04:36:31.280949 UTC dns_group = internal generation = 1
15552025-06-04T04:46:31.332ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 437.872486ms iteration = 11 status = {"generation":1}
15562025-06-04T04:46:31.333ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15572025-06-04T04:46:31.334ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15582025-06-04T04:46:31.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15592025-06-04T04:46:31.336ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
15602025-06-04T04:46:31.336ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
15612025-06-04T04:46:31.336ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15622025-06-04T04:46:31.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
15632025-06-04T04:46:31.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15642025-06-04T04:46:31.336ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
15652025-06-04T04:46:31.336ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
15662025-06-04T04:46:31.338ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15672025-06-04T04:46:31.338ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = tuf_artifact_replication body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/artifacts-config
15682025-06-04T04:46:31.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15692025-06-04T04:46:31.340ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15702025-06-04T04:46:31.344ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
15712025-06-04T04:46:31.344ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "22ae314c-ac27-4504-800d-c9a70b289f53", "date": "Wed, 04 Jun 2025 04:46:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15722025-06-04T04:46:31.344ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15732025-06-04T04:46:31.345ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
15742025-06-04T04:46:31.345ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15752025-06-04T04:46:31.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15762025-06-04T04:46:31.346ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "df8f8e74-b1b6-4234-ad63-b86c4758f1a3", "date": "Wed, 04 Jun 2025 04:46:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15772025-06-04T04:46:31.346ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15782025-06-04T04:46:31.346ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15792025-06-04T04:46:31.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15802025-06-04T04:46:31.348ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15812025-06-04T04:46:31.348ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 453.315611ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
15822025-06-04T04:46:31.348ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15832025-06-04T04:46:31.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15842025-06-04T04:46:31.350ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15852025-06-04T04:46:31.350ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
15862025-06-04T04:46:31.353ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
15872025-06-04T04:46:31.353ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15882025-06-04T04:46:31.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15892025-06-04T04:46:31.360ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 0701dcd9-5e68-4dc7-b70e-f6a9729b2647, kind: Service { id: 88f0624a-d154-4dd4-8e91-901bdcc509e0 }, name: Name("nexus-88f0624a-d154-4dd4-8e91-901bdcc509e0"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 36])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5f5e63c2-1bad-4c9a-a936-0d7b3e573801, kind: Service { id: 402ff887-632a-4786-b519-56089ce3f9de }, name: Name("nexus-402ff887-632a-4786-b519-56089ce3f9de"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a944ce0a-5fd5-433b-bea5-f190cf3d2462, kind: Service { id: e0980da9-c26e-46a7-99a5-37b0e000c0d3 }, name: Name("nexus-e0980da9-c26e-46a7-99a5-37b0e000c0d3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 03cc49c8-dc4e-4405-b5fb-af38e56c3cb8, kind: Service { id: fd2bb11e-a66c-4a76-9d9e-ddc3f90ca952 }, name: Name("external-dns-fd2bb11e-a66c-4a76-9d9e-ddc3f90ca952"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 20af10d8-48ea-402c-91ff-75d0d812559b, kind: Service { id: 3147fdc0-57b9-465b-97b1-724db3a98549 }, name: Name("external-dns-3147fdc0-57b9-465b-97b1-724db3a98549"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 206, 198])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
15902025-06-04T04:46:31.360ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15912025-06-04T04:46:31.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15922025-06-04T04:46:31.362ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15932025-06-04T04:46:31.363ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
15942025-06-04T04:46:31.363ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15952025-06-04T04:46:31.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15962025-06-04T04:46:31.402ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3885c8b6-77e6-440b-8001-b176af8c9dbc", "date": "Wed, 04 Jun 2025 04:46:30 GMT"} })
15972025-06-04T04:46:31.402ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15982025-06-04T04:46:31.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15992025-06-04T04:46:31.403ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts-config", status: 204, headers: {"x-request-id": "991468cc-07ae-47b5-b57f-addb30702f97", "date": "Wed, 04 Jun 2025 04:46:31 GMT"} })
16002025-06-04T04:46:31.403ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
16012025-06-04T04:46:31.409ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "e790e4d7-b345-4b8f-a3a6-171d82ccceaa", "content-length": "26", "date": "Wed, 04 Jun 2025 04:46:31 GMT"} })
16022025-06-04T04:46:31.409ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:673 sled = http://[fd00:1122:3344:101::1]:12345
16032025-06-04T04:46:31.411ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 515.91747ms iteration = 3 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":3,"put_config_err":0,"put_config_ok":3,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"generation":1,"operation":"put_config","target_sled":"cb8aa4e2-773a-4f3e-86b7-f32104e9c4de","time":"2025-06-04T04:36:31.366146047Z"},{"operation":"list","target_sled":"cb8aa4e2-773a-4f3e-86b7-f32104e9c4de","time":"2025-06-04T04:36:31.380309022Z"},{"generation":1,"operation":"put_config","target_sled":"cb8aa4e2-773a-4f3e-86b7-f32104e9c4de","time":"2025-06-04T04:41:31.478051725Z"},{"operation":"list","target_sled":"cb8aa4e2-773a-4f3e-86b7-f32104e9c4de","time":"2025-06-04T04:41:31.478311759Z"},{"generation":1,"operation":"put_config","target_sled":"cb8aa4e2-773a-4f3e-86b7-f32104e9c4de","time":"2025-06-04T04:46:31.403285870Z"},{"operation":"list","target_sled":"cb8aa4e2-773a-4f3e-86b7-f32104e9c4de","time":"2025-06-04T04:46:31.409525705Z"}]}
16042025-06-04T04:46:31.430ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
16052025-06-04T04:46:31.430ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
16062025-06-04T04:46:31.430ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8f6abbc-6d91-4d73-b28d-77d1e7b1e073", "content-length": "691", "date": "Wed, 04 Jun 2025 04:46:30 GMT"} })
16072025-06-04T04:46:31.430ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
16082025-06-04T04:46:31.430ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
16092025-06-04T04:46:31.430ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
16102025-06-04T04:46:31.430ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "3fb98f09-3982-44ad-be22-5f09e28b1056", "date": "Wed, 04 Jun 2025 04:46:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16112025-06-04T04:46:31.430ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16122025-06-04T04:46:31.431ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
16132025-06-04T04:46:31.431ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 03cc49c8-dc4e-4405-b5fb-af38e56c3cb8, kind: Service { id: fd2bb11e-a66c-4a76-9d9e-ddc3f90ca952 }, name: Name("external-dns-fd2bb11e-a66c-4a76-9d9e-ddc3f90ca952"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 20af10d8-48ea-402c-91ff-75d0d812559b, kind: Service { id: 3147fdc0-57b9-465b-97b1-724db3a98549 }, name: Name("external-dns-3147fdc0-57b9-465b-97b1-724db3a98549"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 206, 198])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0701dcd9-5e68-4dc7-b70e-f6a9729b2647, kind: Service { id: 88f0624a-d154-4dd4-8e91-901bdcc509e0 }, name: Name("nexus-88f0624a-d154-4dd4-8e91-901bdcc509e0"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 36])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5f5e63c2-1bad-4c9a-a936-0d7b3e573801, kind: Service { id: 402ff887-632a-4786-b519-56089ce3f9de }, name: Name("nexus-402ff887-632a-4786-b519-56089ce3f9de"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a944ce0a-5fd5-433b-bea5-f190cf3d2462, kind: Service { id: e0980da9-c26e-46a7-99a5-37b0e000c0d3 }, name: Name("nexus-e0980da9-c26e-46a7-99a5-37b0e000c0d3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
16142025-06-04T04:46:31.431ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
16152025-06-04T04:46:31.432ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 537.212264ms iteration = 21 status = {}
16162025-06-04T04:46:31.432ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "896aa356-2ce0-4ae7-ba0f-25061aa6299d", "date": "Wed, 04 Jun 2025 04:46:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16172025-06-04T04:46:31.432ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16182025-06-04T04:46:31.433ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16192025-06-04T04:46:31.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16202025-06-04T04:46:31.433ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "48f925dd-459e-4b22-8107-ddde93a32730", "date": "Wed, 04 Jun 2025 04:46:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16212025-06-04T04:46:31.433ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16222025-06-04T04:46:31.435ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16232025-06-04T04:46:31.435ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 540.893509ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
16242025-06-04T04:46:31.436ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16252025-06-04T04:46:31.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16262025-06-04T04:46:31.440ZINFOnexus (BackgroundTasks): VPC route manager sled cb8aa4e2-773a-4f3e-86b7-f32104e9c4de push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
16272025-06-04T04:46:31.440ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16282025-06-04T04:46:31.441ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4c67a7e4-cff1-4c4c-b31a-b38f89385e3d", "date": "Wed, 04 Jun 2025 04:46:30 GMT"} })
16292025-06-04T04:46:31.442ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 547.983687ms iteration = 21 status = {}
16302025-06-04T04:46:31.468ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16312025-06-04T04:46:31.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16322025-06-04T04:46:31.470ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: a0769b7e-afb1-46f8-b225-eac4dddfaf8d, rack_id: 5a147cfa-15ac-4bf0-8777-c82b354c8c36, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(913c54af-e122-4277-b509-f8a495f24eae) } rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch_location = Switch0
16332025-06-04T04:46:31.470ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16342025-06-04T04:46:31.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16352025-06-04T04:46:31.483ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
16362025-06-04T04:46:31.483ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 913c54af-e122-4277-b509-f8a495f24eae
16372025-06-04T04:46:31.483ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
16382025-06-04T04:46:31.483ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16392025-06-04T04:46:31.483ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16402025-06-04T04:46:31.483ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16412025-06-04T04:46:31.483ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16422025-06-04T04:46:31.483ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16432025-06-04T04:46:31.483ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16442025-06-04T04:46:31.483ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16452025-06-04T04:46:31.483ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36
16462025-06-04T04:46:31.483ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16472025-06-04T04:46:31.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16482025-06-04T04:46:31.485ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch_location = Switch0
16492025-06-04T04:46:31.485ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
16502025-06-04T04:46:31.552ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: cb8aa4e2-773a-4f3e-86b7-f32104e9c4de, time_created: 2025-06-04T04:36:24.962423Z, time_modified: 2025-06-04T04:36:24.962423Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 5a147cfa-15ac-4bf0-8777-c82b354c8c36, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(56094621696)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
16512025-06-04T04:46:31.552ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
16522025-06-04T04:46:31.584ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16532025-06-04T04:46:31.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16542025-06-04T04:46:31.586ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16552025-06-04T04:46:31.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16562025-06-04T04:46:31.588ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16572025-06-04T04:46:31.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: cb8aa4e2-773a-4f3e-86b7-f32104e9c4de, lookup_type: ById(cb8aa4e2-773a-4f3e-86b7-f32104e9c4de) } result = Ok(())
16582025-06-04T04:46:31.590ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16592025-06-04T04:46:31.591ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "57c2bae2-4002-4e3d-84ae-cc33c02867b6", "date": "Wed, 04 Jun 2025 04:46:31 GMT"} })
16602025-06-04T04:46:31.593ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:495
16612025-06-04T04:46:31.594ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 698.909818ms
16622025-06-04T04:46:31.594ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 698.919598ms iteration = 3 status = {}
16632025-06-04T04:46:31.607ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e4ac6e96-3d7d-4b57-9eb0-a3942b8e5624", "date": "Wed, 04 Jun 2025 04:46:31 GMT"} })
16642025-06-04T04:46:31.607ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch = Switch0
16652025-06-04T04:46:31.607ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
16662025-06-04T04:46:31.608ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "60834c03-75a0-446c-9e4a-4cb61394becd", "content-length": "682", "date": "Wed, 04 Jun 2025 04:46:31 GMT"} })
16672025-06-04T04:46:31.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16682025-06-04T04:46:31.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16692025-06-04T04:46:31.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16702025-06-04T04:46:31.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16712025-06-04T04:46:31.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16722025-06-04T04:46:31.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16732025-06-04T04:46:31.617ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16742025-06-04T04:46:31.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16752025-06-04T04:46:31.625ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 730.04117ms iteration = 21 status = {}
16762025-06-04T04:46:31.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = ace09739-be37-4277-a034-e41a35fc5407 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
16772025-06-04T04:46:31.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = ace09739-be37-4277-a034-e41a35fc5407 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
16782025-06-04T04:46:31.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = ace09739-be37-4277-a034-e41a35fc5407 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
16792025-06-04T04:46:32.566ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
16802025-06-04T04:46:32.566ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
16812025-06-04T04:46:32.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
16822025-06-04T04:46:32.568ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16832025-06-04T04:46:32.570ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
16842025-06-04T04:46:32.570ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
16852025-06-04T04:46:32.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
16862025-06-04T04:46:32.581ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(527ebe79-52ed-4c19-96a0-1479eeb33342, 0), (f81cc03e-9daf-4db4-9bc1-0011bb1c6fdc, 0), (f2a99db4-ab80-46a5-ba0f-1f049512aa20, 0), (4d038f4f-d3b7-4494-bd75-f3a572b3b8a6, 0)] collection_id = 527ebe79-52ed-4c19-96a0-1479eeb33342
16872025-06-04T04:46:32.581ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
16882025-06-04T04:46:32.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
16892025-06-04T04:46:32.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 573ff902-4b9d-4537-964a-0a043d6e3b74 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
16902025-06-04T04:46:32.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 573ff902-4b9d-4537-964a-0a043d6e3b74 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
16912025-06-04T04:46:32.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2113 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 573ff902-4b9d-4537-964a-0a043d6e3b74 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
16922025-06-04T04:46:33.122ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 527ebe79-52ed-4c19-96a0-1479eeb33342 file = nexus/db-queries/src/db/datastore/inventory.rs:1705 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 84 nerrors = 0 nlast_reconciliation_dataset_results = 0 nlast_reconciliation_disk_results = 0 nlast_reconciliation_zone_results = 0 nnvme_disk_firmware = 11 nomicron_sled_config_datasets = 66 nomicron_sled_config_disks = 9 nomicron_sled_config_zone_nics = 6 nomicron_sled_config_zones = 28 nomicron_sled_configs = 1 nphysical_disks = 11 nrot_pages = 8 nrots = 2 nsled_agents = 1 nsps = 2 nzpools = 9
16932025-06-04T04:46:33.122ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
16942025-06-04T04:46:33.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
16952025-06-04T04:46:33.146ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(f81cc03e-9daf-4db4-9bc1-0011bb1c6fdc, 0), (f2a99db4-ab80-46a5-ba0f-1f049512aa20, 0), (4d038f4f-d3b7-4494-bd75-f3a572b3b8a6, 0), (e7da0c69-24ce-47ba-bd4e-4463430b0446, 0)] collection_id = f81cc03e-9daf-4db4-9bc1-0011bb1c6fdc
16962025-06-04T04:46:33.146ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
16972025-06-04T04:46:33.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
16982025-06-04T04:46:33.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 9b6c3523-de27-4f07-be8a-0a7433d545ae roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
16992025-06-04T04:46:33.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 9b6c3523-de27-4f07-be8a-0a7433d545ae resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
17002025-06-04T04:46:33.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1992 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 9b6c3523-de27-4f07-be8a-0a7433d545ae response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
17012025-06-04T04:46:34.007ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = f81cc03e-9daf-4db4-9bc1-0011bb1c6fdc file = nexus/db-queries/src/db/datastore/inventory.rs:1705 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 84 nerrors = 0 nlast_reconciliation_dataset_results = 0 nlast_reconciliation_disk_results = 0 nlast_reconciliation_zone_results = 0 nnvme_disk_firmware = 11 nomicron_sled_config_datasets = 66 nomicron_sled_config_disks = 9 nomicron_sled_config_zone_nics = 6 nomicron_sled_config_zones = 28 nomicron_sled_configs = 1 nphysical_disks = 11 nrot_pages = 8 nrots = 2 nsled_agents = 1 nsps = 2 nzpools = 9
17022025-06-04T04:46:34.007ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
17032025-06-04T04:46:34.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
17042025-06-04T04:46:34.061ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(f2a99db4-ab80-46a5-ba0f-1f049512aa20, 0), (4d038f4f-d3b7-4494-bd75-f3a572b3b8a6, 0), (e7da0c69-24ce-47ba-bd4e-4463430b0446, 0)]
17052025-06-04T04:46:34.061ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1418, tv_nsec: 227167495 } })
17062025-06-04T04:46:34.092ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
17072025-06-04T04:46:34.092ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
17082025-06-04T04:46:34.092ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
17092025-06-04T04:46:34.092ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "c80aae95-edc3-4107-9930-e169088ff150", "content-length": "476", "date": "Wed, 04 Jun 2025 04:46:33 GMT"} })
17102025-06-04T04:46:34.092ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
17112025-06-04T04:46:34.093ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "92052a43-90cc-4fb1-bbc8-615f7e5e36a6", "content-length": "734", "date": "Wed, 04 Jun 2025 04:46:33 GMT"} })
17122025-06-04T04:46:34.093ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
17132025-06-04T04:46:34.093ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcc33b73-b1ee-4cd2-ac46-49189e64b00e", "content-length": "111", "date": "Wed, 04 Jun 2025 04:46:33 GMT"} })
17142025-06-04T04:46:34.093ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
17152025-06-04T04:46:34.093ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b26b4e1b-dcba-448f-93a6-0fa44e77c495", "content-length": "111", "date": "Wed, 04 Jun 2025 04:46:33 GMT"} })
17162025-06-04T04:46:34.093ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
17172025-06-04T04:46:34.093ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac56132f-fc19-443e-960f-bca57f11b153", "content-length": "170", "date": "Wed, 04 Jun 2025 04:46:33 GMT"} })
17182025-06-04T04:46:34.093ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
17192025-06-04T04:46:34.094ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "45236e50-9e0e-4eca-8055-006a5cefd44f", "content-length": "170", "date": "Wed, 04 Jun 2025 04:46:33 GMT"} })
17202025-06-04T04:46:34.094ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
17212025-06-04T04:46:34.094ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fcf9fd9-2e7f-4c04-a834-a21ce25e2263", "content-length": "179", "date": "Wed, 04 Jun 2025 04:46:33 GMT"} })
17222025-06-04T04:46:34.094ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
17232025-06-04T04:46:34.094ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c97d1f21-9d02-4aab-91ab-3d86824f3e73", "content-length": "179", "date": "Wed, 04 Jun 2025 04:46:33 GMT"} })
17242025-06-04T04:46:34.094ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
17252025-06-04T04:46:34.094ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "91427a68-fe5f-451d-9f85-befc0ad85cc8", "content-length": "702", "date": "Wed, 04 Jun 2025 04:46:33 GMT"} })
17262025-06-04T04:46:34.094ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
17272025-06-04T04:46:34.094ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "03e78b51-eb2a-41d7-81ec-134703122e20", "content-length": "727", "date": "Wed, 04 Jun 2025 04:46:33 GMT"} })
17282025-06-04T04:46:34.094ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
17292025-06-04T04:46:34.095ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a42c1c0f-0c41-4c17-812e-fe910a85a19c", "content-length": "729", "date": "Wed, 04 Jun 2025 04:46:33 GMT"} })
17302025-06-04T04:46:34.095ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
17312025-06-04T04:46:34.095ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "14e7b809-1ac2-4dbc-b638-d5c01ba90c51", "content-length": "728", "date": "Wed, 04 Jun 2025 04:46:34 GMT"} })
17322025-06-04T04:46:34.095ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
17332025-06-04T04:46:34.095ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "51fe7e1c-7100-4c14-90b0-d135a8bf97f5", "content-length": "722", "date": "Wed, 04 Jun 2025 04:46:34 GMT"} })
17342025-06-04T04:46:34.095ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
17352025-06-04T04:46:34.095ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5fd13edb-7777-4ca7-9b85-99cec24613d5", "content-length": "109", "date": "Wed, 04 Jun 2025 04:46:34 GMT"} })
17362025-06-04T04:46:34.095ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
17372025-06-04T04:46:34.096ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc92ffbf-4b0b-4598-a6b4-c644bee31406", "content-length": "109", "date": "Wed, 04 Jun 2025 04:46:34 GMT"} })
17382025-06-04T04:46:34.096ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
17392025-06-04T04:46:34.096ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "133cfc5b-769f-4fe7-8271-bf9b05cb1e0a", "content-length": "169", "date": "Wed, 04 Jun 2025 04:46:34 GMT"} })
17402025-06-04T04:46:34.096ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
17412025-06-04T04:46:34.096ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e488454c-7689-4468-ba30-af363515557d", "content-length": "169", "date": "Wed, 04 Jun 2025 04:46:34 GMT"} })
17422025-06-04T04:46:34.096ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
17432025-06-04T04:46:34.096ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e534789c-cae4-4e41-9fa0-7068082c9170", "content-length": "178", "date": "Wed, 04 Jun 2025 04:46:34 GMT"} })
17442025-06-04T04:46:34.096ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
17452025-06-04T04:46:34.097ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a6dbfb0-bfdc-43e7-b352-14f7b39b6ca6", "content-length": "178", "date": "Wed, 04 Jun 2025 04:46:34 GMT"} })
17462025-06-04T04:46:34.097ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
17472025-06-04T04:46:34.097ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d5e3f6d-6c78-41ad-8149-ce806b850a33", "content-length": "702", "date": "Wed, 04 Jun 2025 04:46:34 GMT"} })
17482025-06-04T04:46:34.097ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
17492025-06-04T04:46:34.097ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3647e913-6306-4d70-9901-7d94ebbb6f77", "content-length": "727", "date": "Wed, 04 Jun 2025 04:46:34 GMT"} })
17502025-06-04T04:46:34.097ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
17512025-06-04T04:46:34.097ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "88d5acb0-7b9f-40cc-9d04-b23bfe5f624b", "content-length": "729", "date": "Wed, 04 Jun 2025 04:46:34 GMT"} })
17522025-06-04T04:46:34.097ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
17532025-06-04T04:46:34.097ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f0e618d-efa5-43dd-b1e4-c5ccd1d99f5c", "content-length": "728", "date": "Wed, 04 Jun 2025 04:46:34 GMT"} })
17542025-06-04T04:46:34.097ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
17552025-06-04T04:46:34.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
17562025-06-04T04:46:34.099ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17572025-06-04T04:46:34.101ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
17582025-06-04T04:46:34.101ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
17592025-06-04T04:46:34.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
17602025-06-04T04:46:34.102ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17612025-06-04T04:46:34.104ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
17622025-06-04T04:46:34.104ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
17632025-06-04T04:46:34.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
17642025-06-04T04:46:34.137ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
17652025-06-04T04:46:34.137ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
17662025-06-04T04:46:34.269ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "57e442a6-432f-4173-a2b1-38b1c3010170", "content-length": "51810", "date": "Wed, 04 Jun 2025 04:46:34 GMT"} })
17672025-06-04T04:46:34.271ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
17682025-06-04T04:46:34.271ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
17692025-06-04T04:46:34.271ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
17702025-06-04T04:46:34.273ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
17712025-06-04T04:46:34.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
17722025-06-04T04:46:34.275ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17732025-06-04T04:46:34.277ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
17742025-06-04T04:46:34.277ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
17752025-06-04T04:46:34.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
17762025-06-04T04:46:34.558ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = f69247c8-e785-42b1-9ac3-1ee24024e596 file = nexus/db-queries/src/db/datastore/inventory.rs:1192
17772025-06-04T04:46:34.558ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = f69247c8-e785-42b1-9ac3-1ee24024e596 time_started = 2025-06-04 04:46:34.092268 UTC
17782025-06-04T04:46:34.558ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 6 reason = Dependency
17792025-06-04T04:46:34.558ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.992061276s iteration = 3 status = {"collection_id":"f69247c8-e785-42b1-9ac3-1ee24024e596","time_done":"2025-06-04 04:46:34.271909 UTC","time_started":"2025-06-04 04:46:34.092268 UTC"}
17802025-06-04T04:46:34.558ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
17812025-06-04T04:46:34.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
17822025-06-04T04:46:34.558ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17832025-06-04T04:46:34.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
17842025-06-04T04:46:34.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17852025-06-04T04:46:34.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17862025-06-04T04:46:34.560ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17872025-06-04T04:46:34.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17882025-06-04T04:46:34.563ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17892025-06-04T04:46:34.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17902025-06-04T04:46:34.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
17912025-06-04T04:46:34.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
17922025-06-04T04:46:34.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
17932025-06-04T04:46:34.565ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17942025-06-04T04:46:34.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17952025-06-04T04:46:34.566ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17962025-06-04T04:46:34.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17972025-06-04T04:46:34.568ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17982025-06-04T04:46:34.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17992025-06-04T04:46:34.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
18002025-06-04T04:46:34.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
18012025-06-04T04:46:34.665ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 107.046054ms iteration = 24 status = {"physical_disks_added":0}
18022025-06-04T04:46:34.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
18032025-06-04T04:46:34.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
18042025-06-04T04:46:34.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18052025-06-04T04:46:34.677ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
18062025-06-04T04:46:34.677ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
18072025-06-04T04:46:34.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
18082025-06-04T04:46:34.679ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18092025-06-04T04:46:34.681ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
18102025-06-04T04:46:34.681ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
18112025-06-04T04:46:34.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
18122025-06-04T04:46:34.683ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
18132025-06-04T04:46:34.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
18142025-06-04T04:46:34.684ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18152025-06-04T04:46:34.686ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
18162025-06-04T04:46:34.686ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
18172025-06-04T04:46:34.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
18182025-06-04T04:46:34.687ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18192025-06-04T04:46:34.688ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
18202025-06-04T04:46:34.688ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
18212025-06-04T04:46:34.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
18222025-06-04T04:46:34.691ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
18232025-06-04T04:46:34.691ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 132.874687ms iteration = 6 status = {"blueprint_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","inventory_collection_id":"f69247c8-e785-42b1-9ac3-1ee24024e596","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
18242025-06-04T04:46:34.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 965984fd-7d23-4cc2-8e18-3c4aa1d19314 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18252025-06-04T04:46:34.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 965984fd-7d23-4cc2-8e18-3c4aa1d19314 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18262025-06-04T04:46:34.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1731 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 965984fd-7d23-4cc2-8e18-3c4aa1d19314 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18272025-06-04T04:46:35.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 22dd945b-1bb5-4cf4-8fa1-2a3c1d176b04 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18282025-06-04T04:46:35.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 22dd945b-1bb5-4cf4-8fa1-2a3c1d176b04 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18292025-06-04T04:46:35.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 22dd945b-1bb5-4cf4-8fa1-2a3c1d176b04 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18302025-06-04T04:46:36.505ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 562 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = 37e8b99f-42f8-42c9-af8d-2de9325f05d4 response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
18312025-06-04T04:46:36.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 38feff78-0793-4039-935b-97e73d80976a roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18322025-06-04T04:46:36.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 38feff78-0793-4039-935b-97e73d80976a resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18332025-06-04T04:46:36.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2328 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 38feff78-0793-4039-935b-97e73d80976a response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18342025-06-04T04:46:37.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5e95641a-36f0-4492-8b65-d1e85b4373ad roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18352025-06-04T04:46:37.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5e95641a-36f0-4492-8b65-d1e85b4373ad resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18362025-06-04T04:46:37.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1968 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5e95641a-36f0-4492-8b65-d1e85b4373ad response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18372025-06-04T04:46:38.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = e4d40544-b5b0-438d-b147-726cac875587 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18382025-06-04T04:46:38.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = e4d40544-b5b0-438d-b147-726cac875587 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18392025-06-04T04:46:38.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2808 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = e4d40544-b5b0-438d-b147-726cac875587 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18402025-06-04T04:46:39.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 787f590e-344d-4f0d-ae83-d0e4037f4c36 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18412025-06-04T04:46:39.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 787f590e-344d-4f0d-ae83-d0e4037f4c36 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18422025-06-04T04:46:39.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 787f590e-344d-4f0d-ae83-d0e4037f4c36 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18432025-06-04T04:46:40.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 6609dcf6-1f72-46ab-ab0f-f5b0957f44ea roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18442025-06-04T04:46:40.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 6609dcf6-1f72-46ab-ab0f-f5b0957f44ea resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18452025-06-04T04:46:40.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2367 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 6609dcf6-1f72-46ab-ab0f-f5b0957f44ea response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18462025-06-04T04:46:40.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
18472025-06-04T04:46:40.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
18482025-06-04T04:46:40.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18492025-06-04T04:46:40.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18502025-06-04T04:46:40.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18512025-06-04T04:46:40.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18522025-06-04T04:46:40.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18532025-06-04T04:46:40.897ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18542025-06-04T04:46:40.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18552025-06-04T04:46:40.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18562025-06-04T04:46:40.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18572025-06-04T04:46:40.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18582025-06-04T04:46:40.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18592025-06-04T04:46:40.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18602025-06-04T04:46:40.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18612025-06-04T04:46:40.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1dd88a28-32c4-4490-89f2-ae05402d904c, lookup_type: ById(1dd88a28-32c4-4490-89f2-ae05402d904c) } result = Ok(())
18622025-06-04T04:46:40.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18632025-06-04T04:46:40.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18642025-06-04T04:46:40.918ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c original_time_created = 2025-06-04 04:36:14.609521 UTC target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c time_created = 2025-06-04 04:36:14.609521 UTC
18652025-06-04T04:46:40.918ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.808566ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","time_created":"2025-06-04T04:36:14.609521Z"}
18662025-06-04T04:46:40.930ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.246875ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18672025-06-04T04:46:41.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 48f762a3-7429-4749-8421-e309ba24a1c5 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18682025-06-04T04:46:41.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 48f762a3-7429-4749-8421-e309ba24a1c5 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18692025-06-04T04:46:41.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2110 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 48f762a3-7429-4749-8421-e309ba24a1c5 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18702025-06-04T04:46:42.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = b3485f24-bdeb-4a9d-af3d-f43345b111a2 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18712025-06-04T04:46:42.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = b3485f24-bdeb-4a9d-af3d-f43345b111a2 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18722025-06-04T04:46:42.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2332 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = b3485f24-bdeb-4a9d-af3d-f43345b111a2 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18732025-06-04T04:46:43.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = e8604240-2ed0-4f99-873c-a44dee4b173d roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18742025-06-04T04:46:43.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = e8604240-2ed0-4f99-873c-a44dee4b173d resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18752025-06-04T04:46:43.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2109 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = e8604240-2ed0-4f99-873c-a44dee4b173d response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18762025-06-04T04:46:44.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 4cf5161c-fd7b-4fb2-b943-1981e152c628 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18772025-06-04T04:46:44.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 4cf5161c-fd7b-4fb2-b943-1981e152c628 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18782025-06-04T04:46:44.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2010 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 4cf5161c-fd7b-4fb2-b943-1981e152c628 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18792025-06-04T04:46:45.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = cb3c1cb8-bce1-4284-9197-bc57837e86e8 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18802025-06-04T04:46:45.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = cb3c1cb8-bce1-4284-9197-bc57837e86e8 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18812025-06-04T04:46:45.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = cb3c1cb8-bce1-4284-9197-bc57837e86e8 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18822025-06-04T04:46:46.504ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 490 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = 934dd822-7455-40b7-8c63-8583e97ed14c response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
18832025-06-04T04:46:46.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = e88abb68-4f1d-44a2-bace-deb1011a27c3 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18842025-06-04T04:46:46.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = e88abb68-4f1d-44a2-bace-deb1011a27c3 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18852025-06-04T04:46:46.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2057 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = e88abb68-4f1d-44a2-bace-deb1011a27c3 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18862025-06-04T04:46:47.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 59bc66ca-ee31-4004-994e-b7c5ef4f4da3 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18872025-06-04T04:46:47.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 59bc66ca-ee31-4004-994e-b7c5ef4f4da3 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18882025-06-04T04:46:47.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2075 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 59bc66ca-ee31-4004-994e-b7c5ef4f4da3 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18892025-06-04T04:46:48.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 59b177d1-b662-4b34-8391-f833fe09e24c roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18902025-06-04T04:46:48.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 59b177d1-b662-4b34-8391-f833fe09e24c resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18912025-06-04T04:46:48.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1955 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 59b177d1-b662-4b34-8391-f833fe09e24c response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18922025-06-04T04:46:49.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f9e2f8ec-9f82-44bb-bec3-a980c1cf6e47 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18932025-06-04T04:46:49.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f9e2f8ec-9f82-44bb-bec3-a980c1cf6e47 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18942025-06-04T04:46:49.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2563 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f9e2f8ec-9f82-44bb-bec3-a980c1cf6e47 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
18952025-06-04T04:46:50.894ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
18962025-06-04T04:46:50.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18972025-06-04T04:46:50.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
18982025-06-04T04:46:50.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18992025-06-04T04:46:50.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19002025-06-04T04:46:50.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19012025-06-04T04:46:50.896ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19022025-06-04T04:46:50.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19032025-06-04T04:46:50.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19042025-06-04T04:46:50.898ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.739357ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19052025-06-04T04:46:50.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19062025-06-04T04:46:50.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19072025-06-04T04:46:50.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19082025-06-04T04:46:50.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19092025-06-04T04:46:50.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19102025-06-04T04:46:50.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19112025-06-04T04:46:50.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1dd88a28-32c4-4490-89f2-ae05402d904c, lookup_type: ById(1dd88a28-32c4-4490-89f2-ae05402d904c) } result = Ok(())
19122025-06-04T04:46:50.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19132025-06-04T04:46:50.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19142025-06-04T04:46:50.913ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c original_time_created = 2025-06-04 04:36:14.609521 UTC target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c time_created = 2025-06-04 04:36:14.609521 UTC
19152025-06-04T04:46:50.913ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.915947ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","time_created":"2025-06-04T04:36:14.609521Z"}
19162025-06-04T04:46:51.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = de7e295b-7850-4498-bc47-50c60de69d6c roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19172025-06-04T04:46:51.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = de7e295b-7850-4498-bc47-50c60de69d6c resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19182025-06-04T04:46:51.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1961 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = de7e295b-7850-4498-bc47-50c60de69d6c response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19192025-06-04T04:46:52.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2928b68a-afc7-4e02-9485-e6d50b7b4203 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19202025-06-04T04:46:52.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2928b68a-afc7-4e02-9485-e6d50b7b4203 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19212025-06-04T04:46:52.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2308 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2928b68a-afc7-4e02-9485-e6d50b7b4203 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19222025-06-04T04:46:53.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = feaec78c-4800-4a77-a69c-1582e8a4092f roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19232025-06-04T04:46:53.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = feaec78c-4800-4a77-a69c-1582e8a4092f resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19242025-06-04T04:46:53.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1763 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = feaec78c-4800-4a77-a69c-1582e8a4092f response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19252025-06-04T04:46:54.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 6b834941-15bc-46b0-938a-0dd8b7bc03a5 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19262025-06-04T04:46:54.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 6b834941-15bc-46b0-938a-0dd8b7bc03a5 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19272025-06-04T04:46:54.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1940 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 6b834941-15bc-46b0-938a-0dd8b7bc03a5 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19282025-06-04T04:46:55.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 7974e413-3870-4d2e-a715-0b349457ba50 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19292025-06-04T04:46:55.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 7974e413-3870-4d2e-a715-0b349457ba50 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19302025-06-04T04:46:55.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2279 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 7974e413-3870-4d2e-a715-0b349457ba50 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19312025-06-04T04:46:56.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 460ecc60-ad87-4a1e-9214-3682170dc2ac roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19322025-06-04T04:46:56.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 460ecc60-ad87-4a1e-9214-3682170dc2ac resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19332025-06-04T04:46:56.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2086 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 460ecc60-ad87-4a1e-9214-3682170dc2ac response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19342025-06-04T04:46:56.505ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 563 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = 8018ea0c-2b35-42ba-88eb-cf0f7951f493 response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
19352025-06-04T04:46:57.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3ebef014-22ec-455d-9708-466cce5afa7f roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19362025-06-04T04:46:57.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3ebef014-22ec-455d-9708-466cce5afa7f resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19372025-06-04T04:46:57.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3ebef014-22ec-455d-9708-466cce5afa7f response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19382025-06-04T04:46:58.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 7c58fdaa-03e7-4115-a403-99f17fcafe54 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19392025-06-04T04:46:58.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 7c58fdaa-03e7-4115-a403-99f17fcafe54 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19402025-06-04T04:46:58.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1909 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 7c58fdaa-03e7-4115-a403-99f17fcafe54 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19412025-06-04T04:46:59.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = ea71be32-d232-4ccb-9a48-9cda0d216ab9 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19422025-06-04T04:46:59.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = ea71be32-d232-4ccb-9a48-9cda0d216ab9 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19432025-06-04T04:46:59.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2743 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = ea71be32-d232-4ccb-9a48-9cda0d216ab9 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19442025-06-04T04:47:00.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = de25e3d2-0fce-46fb-a18b-246b76e23da6 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19452025-06-04T04:47:00.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = de25e3d2-0fce-46fb-a18b-246b76e23da6 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19462025-06-04T04:47:00.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1893 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = de25e3d2-0fce-46fb-a18b-246b76e23da6 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
19472025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
19482025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
19492025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
19502025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19512025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19522025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
19532025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
19542025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
19552025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19562025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
19572025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19582025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
19592025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19602025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
19612025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19622025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
19632025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
19642025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19652025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19662025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 22 reason = Timeout
19672025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
19682025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
19692025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
19702025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19712025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
19722025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
19732025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19742025-06-04T04:47:00.895ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
19752025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19762025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19772025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19782025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
19792025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19802025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19812025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19822025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19832025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19842025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19852025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19862025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19872025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
19882025-06-04T04:47:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19892025-06-04T04:47:00.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
19902025-06-04T04:47:00.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19912025-06-04T04:47:00.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
19922025-06-04T04:47:00.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
19932025-06-04T04:47:00.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
19942025-06-04T04:47:00.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
19952025-06-04T04:47:00.896ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 22 reason = Timeout
19962025-06-04T04:47:00.896ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
19972025-06-04T04:47:00.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
19982025-06-04T04:47:00.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19992025-06-04T04:47:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
20002025-06-04T04:47:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
20012025-06-04T04:47:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20022025-06-04T04:47:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
20032025-06-04T04:47:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20042025-06-04T04:47:00.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20052025-06-04T04:47:00.898ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20062025-06-04T04:47:00.899ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.063762ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
20072025-06-04T04:47:00.900ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1445, tv_nsec: 65471848 } })
20082025-06-04T04:47:00.900ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
20092025-06-04T04:47:00.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20102025-06-04T04:47:00.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20112025-06-04T04:47:00.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20122025-06-04T04:47:00.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
20132025-06-04T04:47:00.902ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20142025-06-04T04:47:00.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20152025-06-04T04:47:00.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20162025-06-04T04:47:00.904ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20172025-06-04T04:47:00.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1445, tv_nsec: 69833315 } })
20182025-06-04T04:47:00.904ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
20192025-06-04T04:47:00.905ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20202025-06-04T04:47:00.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
20212025-06-04T04:47:00.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20222025-06-04T04:47:00.906ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20232025-06-04T04:47:00.906ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
20242025-06-04T04:47:00.906ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20252025-06-04T04:47:00.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20262025-06-04T04:47:00.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20272025-06-04T04:47:00.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20282025-06-04T04:47:00.906ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20292025-06-04T04:47:00.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20302025-06-04T04:47:00.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
20312025-06-04T04:47:00.907ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20322025-06-04T04:47:00.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20332025-06-04T04:47:00.908ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20342025-06-04T04:47:00.911ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20352025-06-04T04:47:00.911ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20362025-06-04T04:47:00.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20372025-06-04T04:47:00.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20382025-06-04T04:47:00.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20392025-06-04T04:47:00.917ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20402025-06-04T04:47:00.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20412025-06-04T04:47:00.917ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1445, tv_nsec: 82894953 } })
20422025-06-04T04:47:00.918ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36
20432025-06-04T04:47:00.920ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20442025-06-04T04:47:00.920ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20452025-06-04T04:47:00.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20462025-06-04T04:47:00.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20472025-06-04T04:47:00.921ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20482025-06-04T04:47:00.923ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20492025-06-04T04:47:00.923ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20502025-06-04T04:47:00.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20512025-06-04T04:47:00.936ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20522025-06-04T04:47:00.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20532025-06-04T04:47:00.939ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 44.038988ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20542025-06-04T04:47:00.941ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20552025-06-04T04:47:00.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20562025-06-04T04:47:00.955ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 59.184448ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
20572025-06-04T04:47:00.961ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20582025-06-04T04:47:00.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20592025-06-04T04:47:00.961ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 65.156159ms iteration = 22 status = {"errors":[],"requests_created_ok":[]}
20602025-06-04T04:47:00.965ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20612025-06-04T04:47:00.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20622025-06-04T04:47:00.966ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 69.771619ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
20632025-06-04T04:47:00.967ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20642025-06-04T04:47:00.967ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20652025-06-04T04:47:00.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20662025-06-04T04:47:00.968ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20672025-06-04T04:47:00.969ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
20682025-06-04T04:47:00.969ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
20692025-06-04T04:47:00.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
20702025-06-04T04:47:00.971ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20712025-06-04T04:47:00.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1dd88a28-32c4-4490-89f2-ae05402d904c, lookup_type: ById(1dd88a28-32c4-4490-89f2-ae05402d904c) } result = Ok(())
20722025-06-04T04:47:00.973ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20732025-06-04T04:47:00.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20742025-06-04T04:47:00.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cb8aa4e2-773a-4f3e-86b7-f32104e9c4de, lookup_type: ById(cb8aa4e2-773a-4f3e-86b7-f32104e9c4de) } result = Ok(())
20752025-06-04T04:47:00.975ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20762025-06-04T04:47:00.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20772025-06-04T04:47:00.975ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 79.624788ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
20782025-06-04T04:47:00.979ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 84.024965ms iteration = 22 status = 0
20792025-06-04T04:47:00.981ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20802025-06-04T04:47:00.981ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20812025-06-04T04:47:00.981ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
20822025-06-04T04:47:00.981ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20832025-06-04T04:47:00.982ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
20842025-06-04T04:47:00.982ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20852025-06-04T04:47:00.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20862025-06-04T04:47:00.982ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "db264612-35c2-49b5-a7cc-fcc07a75bc7d", "content-length": "26", "date": "Wed, 04 Jun 2025 04:47:00 GMT"} })
20872025-06-04T04:47:00.982ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20882025-06-04T04:47:00.983ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20892025-06-04T04:47:00.983ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20902025-06-04T04:47:00.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20912025-06-04T04:47:00.984ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
20922025-06-04T04:47:00.984ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 89.306956ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
20932025-06-04T04:47:00.984ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c original_time_created = 2025-06-04 04:36:14.609521 UTC target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c time_created = 2025-06-04 04:36:14.609521 UTC
20942025-06-04T04:47:00.984ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20952025-06-04T04:47:00.984ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 89.743703ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","time_created":"2025-06-04T04:36:14.609521Z"}
20962025-06-04T04:47:00.989ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
20972025-06-04T04:47:00.989ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20982025-06-04T04:47:00.989ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8284ce15-f804-4914-aae7-fa67579007f7", "content-length": "26", "date": "Wed, 04 Jun 2025 04:47:00 GMT"} })
20992025-06-04T04:47:00.989ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21002025-06-04T04:47:00.991ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21012025-06-04T04:47:00.992ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 97.163065ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
21022025-06-04T04:47:00.994ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 99.616052ms iteration = 25 status = {"physical_disks_added":0}
21032025-06-04T04:47:01.006ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21042025-06-04T04:47:01.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21052025-06-04T04:47:01.008ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 zone_address = fd00:1122:3344:101::2
21062025-06-04T04:47:01.008ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21072025-06-04T04:47:01.008ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e788fbe5-78db-4100-85d3-a7ecfb3b6bef", "content-length": "26", "date": "Wed, 04 Jun 2025 04:47:00 GMT"} })
21082025-06-04T04:47:01.008ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21092025-06-04T04:47:01.011ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36
21102025-06-04T04:47:01.027ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
21112025-06-04T04:47:01.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
21122025-06-04T04:47:01.029ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21132025-06-04T04:47:01.029ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
21142025-06-04T04:47:01.031ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 136.248168ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
21152025-06-04T04:47:01.051ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21162025-06-04T04:47:01.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21172025-06-04T04:47:01.053ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 157.516091ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
21182025-06-04T04:47:01.064ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21192025-06-04T04:47:01.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
21202025-06-04T04:47:01.066ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
21212025-06-04T04:47:01.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
21222025-06-04T04:47:01.120ZINFOnexus (BackgroundTasks): VPC route manager sled cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
21232025-06-04T04:47:01.120ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21242025-06-04T04:47:01.135ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "03317be2-13f1-4402-8b94-d5eaf9b6dad0", "content-length": "372", "date": "Wed, 04 Jun 2025 04:47:01 GMT"} })
21252025-06-04T04:47:01.135ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21262025-06-04T04:47:01.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21272025-06-04T04:47:01.159ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
21282025-06-04T04:47:01.160ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 264.717458ms iteration = 22 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
21292025-06-04T04:47:01.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3ba7d2d3-9b47-4edf-b233-ad4124ab8dc9 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
21302025-06-04T04:47:01.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3ba7d2d3-9b47-4edf-b233-ad4124ab8dc9 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
21312025-06-04T04:47:01.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2654 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3ba7d2d3-9b47-4edf-b233-ad4124ab8dc9 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
21322025-06-04T04:47:01.187ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
21332025-06-04T04:47:01.188ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
21342025-06-04T04:47:01.197ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 302.781266ms iteration = 22 status = {}
21352025-06-04T04:47:01.204ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21362025-06-04T04:47:01.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21372025-06-04T04:47:01.207ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 311.772783ms iteration = 22 status = null
21382025-06-04T04:47:01.228ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21392025-06-04T04:47:01.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21402025-06-04T04:47:01.240ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21412025-06-04T04:47:01.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21422025-06-04T04:47:01.242ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: a0769b7e-afb1-46f8-b225-eac4dddfaf8d, rack_id: 5a147cfa-15ac-4bf0-8777-c82b354c8c36, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(913c54af-e122-4277-b509-f8a495f24eae) } rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch_location = Switch0
21432025-06-04T04:47:01.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21442025-06-04T04:47:01.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21452025-06-04T04:47:01.253ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
21462025-06-04T04:47:01.253ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 913c54af-e122-4277-b509-f8a495f24eae
21472025-06-04T04:47:01.254ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
21482025-06-04T04:47:01.254ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
21492025-06-04T04:47:01.254ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21502025-06-04T04:47:01.254ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21512025-06-04T04:47:01.254ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21522025-06-04T04:47:01.254ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21532025-06-04T04:47:01.254ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21542025-06-04T04:47:01.254ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21552025-06-04T04:47:01.254ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36
21562025-06-04T04:47:01.254ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21572025-06-04T04:47:01.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21582025-06-04T04:47:01.257ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch_location = Switch0
21592025-06-04T04:47:01.257ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
21602025-06-04T04:47:01.260ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21612025-06-04T04:47:01.262ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21622025-06-04T04:47:01.262ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21632025-06-04T04:47:01.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21642025-06-04T04:47:01.263ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21652025-06-04T04:47:01.265ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21662025-06-04T04:47:01.265ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21672025-06-04T04:47:01.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21682025-06-04T04:47:01.282ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9e0fbc96-54e9-40f8-ad52-b88fb04c6e79", "date": "Wed, 04 Jun 2025 04:47:00 GMT"} })
21692025-06-04T04:47:01.282ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21702025-06-04T04:47:01.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21712025-06-04T04:47:01.285ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21722025-06-04T04:47:01.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21732025-06-04T04:47:01.289ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21742025-06-04T04:47:01.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21752025-06-04T04:47:01.293ZINFOnexus (BackgroundTasks): VPC route manager sled cb8aa4e2-773a-4f3e-86b7-f32104e9c4de push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
21762025-06-04T04:47:01.293ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21772025-06-04T04:47:01.293ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "97cbca0a-e736-4b40-99d6-4d09cd8692c3", "date": "Wed, 04 Jun 2025 04:47:01 GMT"} })
21782025-06-04T04:47:01.295ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 400.142433ms iteration = 22 status = {}
21792025-06-04T04:47:01.364ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
21802025-06-04T04:47:01.364ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0d66d6a-1ac0-4b9b-9cde-6170907e7eef", "content-length": "691", "date": "Wed, 04 Jun 2025 04:47:01 GMT"} })
21812025-06-04T04:47:01.364ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
21822025-06-04T04:47:01.364ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
21832025-06-04T04:47:01.364ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
21842025-06-04T04:47:01.365ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 470.071335ms iteration = 22 status = {}
21852025-06-04T04:47:01.389ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e2a042ff-fe0d-4ba2-af7a-7ca1b455db25", "date": "Wed, 04 Jun 2025 04:47:00 GMT"} })
21862025-06-04T04:47:01.389ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch = Switch0
21872025-06-04T04:47:01.389ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
21882025-06-04T04:47:01.389ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f2a3c1f-6ba1-457a-8e49-3c7596488953", "content-length": "682", "date": "Wed, 04 Jun 2025 04:47:01 GMT"} })
21892025-06-04T04:47:01.389ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21902025-06-04T04:47:01.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21912025-06-04T04:47:01.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21922025-06-04T04:47:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21932025-06-04T04:47:01.398ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21942025-06-04T04:47:01.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21952025-06-04T04:47:01.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21962025-06-04T04:47:01.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21972025-06-04T04:47:01.408ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 513.023156ms iteration = 22 status = {}
21982025-06-04T04:47:01.492ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:38321
21992025-06-04T04:47:01.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38321 req_id = 49f25274-1d97-425e-8902-fc4033909c3e roles = RoleSet { roles: {} } uri = /metrics/collectors/6e958f0b-8d3a-47ee-bfea-40bd8f174cf7/producers?sort_by=id_ascending
22002025-06-04T04:47:01.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38321 req_id = 49f25274-1d97-425e-8902-fc4033909c3e resource = Database result = Ok(()) uri = /metrics/collectors/6e958f0b-8d3a-47ee-bfea-40bd8f174cf7/producers?sort_by=id_ascending
22012025-06-04T04:47:01.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3395 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38321 req_id = 49f25274-1d97-425e-8902-fc4033909c3e response_code = 200 uri = /metrics/collectors/6e958f0b-8d3a-47ee-bfea-40bd8f174cf7/producers?sort_by=id_ascending
22022025-06-04T04:47:01.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38321 req_id = af72fac6-a238-46e4-8014-daa11163160c roles = RoleSet { roles: {} } uri = /metrics/collectors/6e958f0b-8d3a-47ee-bfea-40bd8f174cf7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjAzODE5NC0yMDU3LTQ0NmYtOGM2ZS04YjA1YWFlODk3NWQifX0%3D
22032025-06-04T04:47:01.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38321 req_id = af72fac6-a238-46e4-8014-daa11163160c resource = Database result = Ok(()) uri = /metrics/collectors/6e958f0b-8d3a-47ee-bfea-40bd8f174cf7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjAzODE5NC0yMDU3LTQ0NmYtOGM2ZS04YjA1YWFlODk3NWQifX0%3D
22042025-06-04T04:47:01.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2150 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38321 req_id = af72fac6-a238-46e4-8014-daa11163160c response_code = 200 uri = /metrics/collectors/6e958f0b-8d3a-47ee-bfea-40bd8f174cf7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjAzODE5NC0yMDU3LTQ0NmYtOGM2ZS04YjA1YWFlODk3NWQifX0%3D
22052025-06-04T04:47:02.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 32227ab9-b7a8-4366-902a-806f5574a712 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22062025-06-04T04:47:02.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 32227ab9-b7a8-4366-902a-806f5574a712 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22072025-06-04T04:47:02.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2429 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 32227ab9-b7a8-4366-902a-806f5574a712 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22082025-06-04T04:47:03.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 91340618-8617-40c7-b142-3c8a79df65ec roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22092025-06-04T04:47:03.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 91340618-8617-40c7-b142-3c8a79df65ec resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22102025-06-04T04:47:03.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2269 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 91340618-8617-40c7-b142-3c8a79df65ec response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22112025-06-04T04:47:04.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 18ff71f0-3701-4c3e-9b20-fa8d844cf62c roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22122025-06-04T04:47:04.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 18ff71f0-3701-4c3e-9b20-fa8d844cf62c resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22132025-06-04T04:47:04.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1789 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 18ff71f0-3701-4c3e-9b20-fa8d844cf62c response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22142025-06-04T04:47:05.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c339f41a-9515-4d89-9e11-549e8b393e42 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22152025-06-04T04:47:05.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c339f41a-9515-4d89-9e11-549e8b393e42 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22162025-06-04T04:47:05.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c339f41a-9515-4d89-9e11-549e8b393e42 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22172025-06-04T04:47:06.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2bfe0084-9a52-43c3-a07d-b5186f1edbe9 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22182025-06-04T04:47:06.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2bfe0084-9a52-43c3-a07d-b5186f1edbe9 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22192025-06-04T04:47:06.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2987 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2bfe0084-9a52-43c3-a07d-b5186f1edbe9 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22202025-06-04T04:47:06.504ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 705 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = 8755f591-28f7-4d75-9454-d36908c76fad response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
22212025-06-04T04:47:07.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = a3b987e0-bb61-4d68-923e-358678d1d84e roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22222025-06-04T04:47:07.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = a3b987e0-bb61-4d68-923e-358678d1d84e resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22232025-06-04T04:47:07.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1948 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = a3b987e0-bb61-4d68-923e-358678d1d84e response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22242025-06-04T04:47:08.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = fcc5f77f-cd4d-48d9-829c-e29faadc78b6 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22252025-06-04T04:47:08.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = fcc5f77f-cd4d-48d9-829c-e29faadc78b6 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22262025-06-04T04:47:08.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1995 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = fcc5f77f-cd4d-48d9-829c-e29faadc78b6 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22272025-06-04T04:47:09.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 84d7db07-773f-4830-95fe-8ac47d2cee43 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22282025-06-04T04:47:09.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 84d7db07-773f-4830-95fe-8ac47d2cee43 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22292025-06-04T04:47:09.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1827 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 84d7db07-773f-4830-95fe-8ac47d2cee43 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22302025-06-04T04:47:10.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 6d41221b-c85d-4186-a53f-8edd77268ab4 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22312025-06-04T04:47:10.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 6d41221b-c85d-4186-a53f-8edd77268ab4 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22322025-06-04T04:47:10.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 6d41221b-c85d-4186-a53f-8edd77268ab4 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22332025-06-04T04:47:10.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
22342025-06-04T04:47:10.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
22352025-06-04T04:47:10.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22362025-06-04T04:47:10.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22372025-06-04T04:47:10.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22382025-06-04T04:47:10.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22392025-06-04T04:47:10.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22402025-06-04T04:47:10.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22412025-06-04T04:47:10.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22422025-06-04T04:47:10.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22432025-06-04T04:47:10.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22442025-06-04T04:47:10.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22452025-06-04T04:47:10.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22462025-06-04T04:47:10.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1dd88a28-32c4-4490-89f2-ae05402d904c, lookup_type: ById(1dd88a28-32c4-4490-89f2-ae05402d904c) } result = Ok(())
22472025-06-04T04:47:10.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22482025-06-04T04:47:10.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22492025-06-04T04:47:10.924ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c original_time_created = 2025-06-04 04:36:14.609521 UTC target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c time_created = 2025-06-04 04:36:14.609521 UTC
22502025-06-04T04:47:10.924ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 29.407876ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","time_created":"2025-06-04T04:36:14.609521Z"}
22512025-06-04T04:47:10.932ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22522025-06-04T04:47:10.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22532025-06-04T04:47:10.963ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.681032ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22542025-06-04T04:47:11.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 1a3953f3-c2e3-42bd-a15b-f69a82878372 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22552025-06-04T04:47:11.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 1a3953f3-c2e3-42bd-a15b-f69a82878372 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22562025-06-04T04:47:11.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 1a3953f3-c2e3-42bd-a15b-f69a82878372 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22572025-06-04T04:47:12.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2ed3de82-3222-47c1-9054-df6492ea08a6 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22582025-06-04T04:47:12.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2ed3de82-3222-47c1-9054-df6492ea08a6 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22592025-06-04T04:47:12.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2374 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2ed3de82-3222-47c1-9054-df6492ea08a6 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22602025-06-04T04:47:13.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 6cbdf6bd-176d-41c0-9d18-8fb9a70ba400 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22612025-06-04T04:47:13.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 6cbdf6bd-176d-41c0-9d18-8fb9a70ba400 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22622025-06-04T04:47:13.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1586 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 6cbdf6bd-176d-41c0-9d18-8fb9a70ba400 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22632025-06-04T04:47:14.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 86ea5629-a960-4edf-aaed-30b8ef61b46c roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22642025-06-04T04:47:14.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 86ea5629-a960-4edf-aaed-30b8ef61b46c resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22652025-06-04T04:47:14.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2545 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 86ea5629-a960-4edf-aaed-30b8ef61b46c response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22662025-06-04T04:47:15.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 4b23aba7-01ec-49c9-9503-c75a1271888b roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22672025-06-04T04:47:15.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 4b23aba7-01ec-49c9-9503-c75a1271888b resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22682025-06-04T04:47:15.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2498 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 4b23aba7-01ec-49c9-9503-c75a1271888b response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22692025-06-04T04:47:16.504ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 793 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = f3697cfc-0e5f-466e-b552-788c72d957f7 response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
22702025-06-04T04:47:16.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = a4fd7d71-a9d6-47dd-bcc0-fadff4c35501 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22712025-06-04T04:47:16.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = a4fd7d71-a9d6-47dd-bcc0-fadff4c35501 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22722025-06-04T04:47:16.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2019 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = a4fd7d71-a9d6-47dd-bcc0-fadff4c35501 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22732025-06-04T04:47:17.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = cbfed603-9c00-4072-804f-545abe5b92d4 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22742025-06-04T04:47:17.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = cbfed603-9c00-4072-804f-545abe5b92d4 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22752025-06-04T04:47:17.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2727 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = cbfed603-9c00-4072-804f-545abe5b92d4 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22762025-06-04T04:47:18.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 8c375299-c3f7-439f-a268-9ea5c2d5c28a roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22772025-06-04T04:47:18.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 8c375299-c3f7-439f-a268-9ea5c2d5c28a resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22782025-06-04T04:47:18.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1826 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 8c375299-c3f7-439f-a268-9ea5c2d5c28a response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22792025-06-04T04:47:19.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = d7441a65-2d60-493e-9d2f-84080d9d6f72 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22802025-06-04T04:47:19.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = d7441a65-2d60-493e-9d2f-84080d9d6f72 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22812025-06-04T04:47:19.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2117 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = d7441a65-2d60-493e-9d2f-84080d9d6f72 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22822025-06-04T04:47:20.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2c0a3b30-46c1-4c0b-947a-8450a5cca95f roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22832025-06-04T04:47:20.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2c0a3b30-46c1-4c0b-947a-8450a5cca95f resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22842025-06-04T04:47:20.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2407 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2c0a3b30-46c1-4c0b-947a-8450a5cca95f response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
22852025-06-04T04:47:20.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
22862025-06-04T04:47:20.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22872025-06-04T04:47:20.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
22882025-06-04T04:47:20.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22892025-06-04T04:47:20.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22902025-06-04T04:47:20.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22912025-06-04T04:47:20.896ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22922025-06-04T04:47:20.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22932025-06-04T04:47:20.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22942025-06-04T04:47:20.898ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.409322ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22952025-06-04T04:47:20.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22962025-06-04T04:47:20.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22972025-06-04T04:47:20.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22982025-06-04T04:47:20.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22992025-06-04T04:47:20.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23002025-06-04T04:47:20.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23012025-06-04T04:47:20.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1dd88a28-32c4-4490-89f2-ae05402d904c, lookup_type: ById(1dd88a28-32c4-4490-89f2-ae05402d904c) } result = Ok(())
23022025-06-04T04:47:20.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23032025-06-04T04:47:20.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23042025-06-04T04:47:20.916ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c original_time_created = 2025-06-04 04:36:14.609521 UTC target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c time_created = 2025-06-04 04:36:14.609521 UTC
23052025-06-04T04:47:20.916ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.701229ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","time_created":"2025-06-04T04:36:14.609521Z"}
23062025-06-04T04:47:21.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c8d034a6-98d1-4e2f-b317-5ecf695481bc roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23072025-06-04T04:47:21.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c8d034a6-98d1-4e2f-b317-5ecf695481bc resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23082025-06-04T04:47:21.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1933 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c8d034a6-98d1-4e2f-b317-5ecf695481bc response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23092025-06-04T04:47:22.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 076830f5-5dc5-4eef-9273-fbd71639c897 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23102025-06-04T04:47:22.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 076830f5-5dc5-4eef-9273-fbd71639c897 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23112025-06-04T04:47:22.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1805 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 076830f5-5dc5-4eef-9273-fbd71639c897 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23122025-06-04T04:47:23.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 95b5b792-0559-4d42-a190-6d093c0c4f11 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23132025-06-04T04:47:23.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 95b5b792-0559-4d42-a190-6d093c0c4f11 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23142025-06-04T04:47:23.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2200 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 95b5b792-0559-4d42-a190-6d093c0c4f11 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23152025-06-04T04:47:24.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f6a3292e-7e30-425f-8922-ca5f8062a109 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23162025-06-04T04:47:24.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f6a3292e-7e30-425f-8922-ca5f8062a109 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23172025-06-04T04:47:24.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f6a3292e-7e30-425f-8922-ca5f8062a109 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23182025-06-04T04:47:25.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2da2aa37-1ab8-487e-ae6c-8cd31efa9a7f roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23192025-06-04T04:47:25.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2da2aa37-1ab8-487e-ae6c-8cd31efa9a7f resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23202025-06-04T04:47:25.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2530 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2da2aa37-1ab8-487e-ae6c-8cd31efa9a7f response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23212025-06-04T04:47:26.505ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 788 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = 717af72d-b3f1-4a9e-9d1d-b20811726b80 response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
23222025-06-04T04:47:26.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 973dea28-04fb-4f19-99d0-88d0ec9d7e72 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23232025-06-04T04:47:26.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 973dea28-04fb-4f19-99d0-88d0ec9d7e72 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23242025-06-04T04:47:26.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2125 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 973dea28-04fb-4f19-99d0-88d0ec9d7e72 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23252025-06-04T04:47:27.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 95838f3d-6eea-41c5-b63c-72d7064780ec roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23262025-06-04T04:47:27.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 95838f3d-6eea-41c5-b63c-72d7064780ec resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23272025-06-04T04:47:27.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2482 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 95838f3d-6eea-41c5-b63c-72d7064780ec response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23282025-06-04T04:47:28.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2e8242ce-11fd-4629-a881-fd86478adc54 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23292025-06-04T04:47:28.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2e8242ce-11fd-4629-a881-fd86478adc54 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23302025-06-04T04:47:28.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2e8242ce-11fd-4629-a881-fd86478adc54 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23312025-06-04T04:47:29.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 380dcb2e-8077-4419-a60a-23d16da95dca roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23322025-06-04T04:47:29.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 380dcb2e-8077-4419-a60a-23d16da95dca resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23332025-06-04T04:47:29.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1823 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 380dcb2e-8077-4419-a60a-23d16da95dca response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23342025-06-04T04:47:30.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 8eed6c1e-3ac1-4e03-9e2d-94e79d1d27e6 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23352025-06-04T04:47:30.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 8eed6c1e-3ac1-4e03-9e2d-94e79d1d27e6 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23362025-06-04T04:47:30.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 4003 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 8eed6c1e-3ac1-4e03-9e2d-94e79d1d27e6 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
23372025-06-04T04:47:30.894ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
23382025-06-04T04:47:30.894ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23392025-06-04T04:47:30.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
23402025-06-04T04:47:30.894ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
23412025-06-04T04:47:30.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
23422025-06-04T04:47:30.894ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23432025-06-04T04:47:30.894ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
23442025-06-04T04:47:30.894ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-06-04 04:37:30.894700391 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
23452025-06-04T04:47:30.894ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
23462025-06-04T04:47:30.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
23472025-06-04T04:47:30.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
23482025-06-04T04:47:30.894ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
23492025-06-04T04:47:30.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
23502025-06-04T04:47:30.894ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
23512025-06-04T04:47:30.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
23522025-06-04T04:47:30.894ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
23532025-06-04T04:47:30.894ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23542025-06-04T04:47:30.894ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
23552025-06-04T04:47:30.894ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23562025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23572025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
23582025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
23592025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23602025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
23612025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
23622025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23632025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
23642025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
23652025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23662025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23672025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
23682025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
23692025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23702025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
23712025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23722025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23732025-06-04T04:47:30.895ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c
23742025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.11\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c"}
23752025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
23762025-06-04T04:47:30.895ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
23772025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
23782025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
23792025-06-04T04:47:30.895ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
23802025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23812025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
23822025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
23832025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23842025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23852025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
23862025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23872025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
23882025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
23892025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23902025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
23912025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 23 reason = Timeout
23922025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23932025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
23942025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
23952025-06-04T04:47:30.895ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3147fdc0-57b9-465b-97b1-724db3a98549.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fd2bb11e-a66c-4a76-9d9e-ddc3f90ca952.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fd2bb11e-a66c-4a76-9d9e-ddc3f90ca952.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1475, tv_nsec: 60625207 } })
23962025-06-04T04:47:30.895ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6bd72d79-86a4-4394-904a-eda88bc21fd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("badd8271-e80d-44a0-993c-76a669a9eadb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f664b51a-ef20-45b7-9cac-a2aa17e449b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f664b51a-ef20-45b7-9cac-a2aa17e449b7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1475, tv_nsec: 60625477 } })
23972025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
23982025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23992025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24002025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24012025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24022025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24032025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24042025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24052025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
24062025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24072025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
24082025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24092025-06-04T04:47:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24102025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 12 reason = Timeout
24112025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 23 reason = Timeout
24122025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
24132025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
24142025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
24152025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
24162025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
24172025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
24182025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
24192025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
24202025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
24212025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24222025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
24232025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
24242025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
24252025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
24262025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 12 reason = Timeout
24272025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
24282025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
24292025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.624435ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
24302025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
24312025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.548624ms iteration = 12 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
24322025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
24332025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24342025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
24352025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
24362025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
24372025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
24382025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
24392025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
24402025-06-04T04:47:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24412025-06-04T04:47:30.897ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1475, tv_nsec: 62560986 } })
24422025-06-04T04:47:30.897ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
24432025-06-04T04:47:30.897ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24442025-06-04T04:47:30.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24452025-06-04T04:47:30.898ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-06-04 04:37:30.894700391 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
24462025-06-04T04:47:30.898ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.604215ms iteration = 12 status = {"expiration":"2025-06-04T04:37:30.894700391Z","pruned":[]}
24472025-06-04T04:47:30.898ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24482025-06-04T04:47:30.899ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1475, tv_nsec: 64160250 } })
24492025-06-04T04:47:30.899ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24502025-06-04T04:47:30.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24512025-06-04T04:47:30.899ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
24522025-06-04T04:47:30.901ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
24532025-06-04T04:47:30.901ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24542025-06-04T04:47:30.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24552025-06-04T04:47:30.902ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.413302ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
24562025-06-04T04:47:30.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24572025-06-04T04:47:30.904ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24582025-06-04T04:47:30.904ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24592025-06-04T04:47:30.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
24602025-06-04T04:47:30.907ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24612025-06-04T04:47:30.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24622025-06-04T04:47:30.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
24632025-06-04T04:47:30.908ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24642025-06-04T04:47:30.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
24652025-06-04T04:47:30.908ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24662025-06-04T04:47:30.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24672025-06-04T04:47:30.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24682025-06-04T04:47:30.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24692025-06-04T04:47:30.917ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24702025-06-04T04:47:30.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24712025-06-04T04:47:30.920ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24722025-06-04T04:47:30.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
24732025-06-04T04:47:30.920ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
24742025-06-04T04:47:30.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24752025-06-04T04:47:30.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
24762025-06-04T04:47:30.921ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24772025-06-04T04:47:30.921ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
24782025-06-04T04:47:30.921ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24792025-06-04T04:47:30.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24802025-06-04T04:47:30.922ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 26.840787ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
24812025-06-04T04:47:30.923ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
24822025-06-04T04:47:30.923ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 27.495167ms iteration = 12 status = {"by_rx":{},"error":null}
24832025-06-04T04:47:30.926ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 29.955475ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
24842025-06-04T04:47:30.926ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24852025-06-04T04:47:30.927ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24862025-06-04T04:47:30.928ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24872025-06-04T04:47:30.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24882025-06-04T04:47:30.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24892025-06-04T04:47:30.932ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24902025-06-04T04:47:30.936ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24912025-06-04T04:47:30.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24922025-06-04T04:47:30.936ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
24932025-06-04T04:47:30.936ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
24942025-06-04T04:47:30.936ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
24952025-06-04T04:47:30.936ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24962025-06-04T04:47:30.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24972025-06-04T04:47:30.940ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
24982025-06-04T04:47:30.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
24992025-06-04T04:47:30.943ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1475, tv_nsec: 108664076 } })
25002025-06-04T04:47:30.943ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36
25012025-06-04T04:47:30.945ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25022025-06-04T04:47:30.946ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25032025-06-04T04:47:30.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25042025-06-04T04:47:30.948ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
25052025-06-04T04:47:30.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
25062025-06-04T04:47:30.949ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25072025-06-04T04:47:30.949ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
25082025-06-04T04:47:30.949ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25092025-06-04T04:47:30.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25102025-06-04T04:47:30.950ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25112025-06-04T04:47:30.950ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
25122025-06-04T04:47:30.950ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25132025-06-04T04:47:30.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25142025-06-04T04:47:30.954ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25152025-06-04T04:47:30.954ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25162025-06-04T04:47:30.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25172025-06-04T04:47:30.956ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25182025-06-04T04:47:30.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25192025-06-04T04:47:30.958ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 62.151393ms iteration = 12 status = {"dispatched":[],"errors":[],"glob_version":"146.0.0","globs_reprocessed":{},"no_receivers":[]}
25202025-06-04T04:47:30.959ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1dd88a28-32c4-4490-89f2-ae05402d904c, lookup_type: ById(1dd88a28-32c4-4490-89f2-ae05402d904c) } result = Ok(())
25212025-06-04T04:47:30.959ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
25222025-06-04T04:47:30.959ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25232025-06-04T04:47:30.959ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
25242025-06-04T04:47:30.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25252025-06-04T04:47:30.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
25262025-06-04T04:47:30.962ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25272025-06-04T04:47:30.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25282025-06-04T04:47:30.963ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25292025-06-04T04:47:30.963ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
25302025-06-04T04:47:30.963ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 67.88244ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
25312025-06-04T04:47:30.970ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25322025-06-04T04:47:30.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25332025-06-04T04:47:30.972ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25342025-06-04T04:47:30.975ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
25352025-06-04T04:47:30.975ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25362025-06-04T04:47:30.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25372025-06-04T04:47:30.978ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c original_time_created = 2025-06-04 04:36:14.609521 UTC target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c time_created = 2025-06-04 04:36:14.609521 UTC
25382025-06-04T04:47:30.978ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.845007ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","time_created":"2025-06-04T04:36:14.609521Z"}
25392025-06-04T04:47:30.978ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25402025-06-04T04:47:30.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25412025-06-04T04:47:30.980ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25422025-06-04T04:47:30.983ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25432025-06-04T04:47:30.983ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25442025-06-04T04:47:30.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25452025-06-04T04:47:30.984ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25462025-06-04T04:47:30.985ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25472025-06-04T04:47:30.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25482025-06-04T04:47:30.985ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25492025-06-04T04:47:30.985ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 89.459238ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
25502025-06-04T04:47:30.985ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25512025-06-04T04:47:30.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25522025-06-04T04:47:30.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25532025-06-04T04:47:30.987ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25542025-06-04T04:47:30.987ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25552025-06-04T04:47:30.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25562025-06-04T04:47:30.987ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
25572025-06-04T04:47:30.987ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
25582025-06-04T04:47:30.987ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
25592025-06-04T04:47:30.987ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25602025-06-04T04:47:30.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25612025-06-04T04:47:30.988ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25622025-06-04T04:47:30.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25632025-06-04T04:47:30.988ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25642025-06-04T04:47:30.989ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25652025-06-04T04:47:30.989ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25662025-06-04T04:47:30.990ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
25672025-06-04T04:47:30.990ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
25682025-06-04T04:47:30.990ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 94.155049ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
25692025-06-04T04:47:30.991ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25702025-06-04T04:47:30.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25712025-06-04T04:47:30.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25722025-06-04T04:47:30.992ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25732025-06-04T04:47:30.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25742025-06-04T04:47:30.993ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
25752025-06-04T04:47:30.993ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
25762025-06-04T04:47:30.993ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25772025-06-04T04:47:30.993ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25782025-06-04T04:47:30.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
25792025-06-04T04:47:30.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25802025-06-04T04:47:30.994ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 98.311233ms iteration = 23 status = {"errors":[],"requests_created_ok":[]}
25812025-06-04T04:47:30.995ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25822025-06-04T04:47:30.996ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
25832025-06-04T04:47:30.996ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 101.156185ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
25842025-06-04T04:47:31.000ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cb8aa4e2-773a-4f3e-86b7-f32104e9c4de, lookup_type: ById(cb8aa4e2-773a-4f3e-86b7-f32104e9c4de) } result = Ok(())
25852025-06-04T04:47:31.000ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25862025-06-04T04:47:31.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25872025-06-04T04:47:31.008ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 113.081876ms iteration = 23 status = 0
25882025-06-04T04:47:31.023ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
25892025-06-04T04:47:31.023ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 128.188356ms iteration = 23 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
25902025-06-04T04:47:31.028ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
25912025-06-04T04:47:31.028ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 787b83fc-6b83-4eec-b3a2-7c7c59871d86 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
25922025-06-04T04:47:31.028ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25932025-06-04T04:47:31.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25942025-06-04T04:47:31.031ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25952025-06-04T04:47:31.034ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 139.425247ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
25962025-06-04T04:47:31.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25972025-06-04T04:47:31.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25982025-06-04T04:47:31.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25992025-06-04T04:47:31.040ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 144.997531ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26002025-06-04T04:47:31.042ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 787b83fc-6b83-4eec-b3a2-7c7c59871d86 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
26012025-06-04T04:47:31.042ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
26022025-06-04T04:47:31.042ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-06-04 04:36:31.280949 UTC dns_group = internal generation = 1
26032025-06-04T04:47:31.042ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 147.401907ms iteration = 12 status = {"generation":1}
26042025-06-04T04:47:31.047ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26052025-06-04T04:47:31.047ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 151.072593ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
26062025-06-04T04:47:31.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26072025-06-04T04:47:31.056ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26082025-06-04T04:47:31.057ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-06-04T04:36:26.716717Z, time_modified: 2025-06-04T04:36:26.716717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 6ac9285f-aca7-426a-86f8-a677f8a85ac2, db_silo: Silo { identity: SiloIdentity { id: 6ac9285f-aca7-426a-86f8-a677f8a85ac2, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-04T04:36:32.675073Z, time_modified: 2025-06-04T04:36:32.675073Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "26b91f4e65966da67879de126c5f5f1398a4ef21b95a2113db132d6cfa56d902" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 6ac9285f-aca7-426a-86f8-a677f8a85ac2, db_silo: Silo { identity: SiloIdentity { id: 6ac9285f-aca7-426a-86f8-a677f8a85ac2, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-04T04:36:32.675073Z, time_modified: 2025-06-04T04:36:32.675073Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "26b91f4e65966da67879de126c5f5f1398a4ef21b95a2113db132d6cfa56d902" }] }) }
26092025-06-04T04:47:31.057ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 162.808091ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"6ac9285f-aca7-426a-86f8-a677f8a85ac2","tls_certs":["26b91f4e65966da67879de126c5f5f1398a4ef21b95a2113db132d6cfa56d902"]}},"default_endpoint":{"silo_id":"6ac9285f-aca7-426a-86f8-a677f8a85ac2","tls_certs":["26b91f4e65966da67879de126c5f5f1398a4ef21b95a2113db132d6cfa56d902"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
26102025-06-04T04:47:31.058ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
26112025-06-04T04:47:31.058ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
26122025-06-04T04:47:31.058ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 163.189317ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
26132025-06-04T04:47:31.058ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
26142025-06-04T04:47:31.058ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26152025-06-04T04:47:31.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26162025-06-04T04:47:31.062ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
26172025-06-04T04:47:31.062ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ce77201a-6012-44b3-bdd1-aa82b5d93c9b dns_zone_name = oxide.test found_so_far = 0 version = 2
26182025-06-04T04:47:31.062ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26192025-06-04T04:47:31.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26202025-06-04T04:47:31.064ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26212025-06-04T04:47:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
26222025-06-04T04:47:31.068ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26232025-06-04T04:47:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26242025-06-04T04:47:31.071ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ce77201a-6012-44b3-bdd1-aa82b5d93c9b dns_zone_name = oxide.test found_so_far = 4 version = 2
26252025-06-04T04:47:31.071ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
26262025-06-04T04:47:31.071ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-06-04 04:36:32.761780 UTC dns_group = external generation = 2
26272025-06-04T04:47:31.071ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 176.398788ms iteration = 12 status = {"generation":2}
26282025-06-04T04:47:31.072ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
26292025-06-04T04:47:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
26302025-06-04T04:47:31.079ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
26312025-06-04T04:47:31.079ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26322025-06-04T04:47:31.079ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4cfb16c0-d4ef-42e4-a9fa-eb38e6ff5ea3", "content-length": "26", "date": "Wed, 04 Jun 2025 04:47:31 GMT"} })
26332025-06-04T04:47:31.079ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26342025-06-04T04:47:31.081ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26352025-06-04T04:47:31.082ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26362025-06-04T04:47:31.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26372025-06-04T04:47:31.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 193.345755ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
26382025-06-04T04:47:31.127ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26392025-06-04T04:47:31.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26402025-06-04T04:47:31.129ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26412025-06-04T04:47:31.131ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26422025-06-04T04:47:31.131ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26432025-06-04T04:47:31.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26442025-06-04T04:47:31.133ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26452025-06-04T04:47:31.134ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26462025-06-04T04:47:31.134ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26472025-06-04T04:47:31.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26482025-06-04T04:47:31.143ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 247.873202ms iteration = 26 status = {"physical_disks_added":0}
26492025-06-04T04:47:31.159ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
26502025-06-04T04:47:31.159ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26512025-06-04T04:47:31.159ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e589e4a6-366b-4869-ad9d-0e2eaa6652d5", "content-length": "26", "date": "Wed, 04 Jun 2025 04:47:31 GMT"} })
26522025-06-04T04:47:31.159ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26532025-06-04T04:47:31.161ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26542025-06-04T04:47:31.190ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
26552025-06-04T04:47:31.190ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
26562025-06-04T04:47:31.190ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 295.541326ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
26572025-06-04T04:47:31.228ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
26582025-06-04T04:47:31.252ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26592025-06-04T04:47:31.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26602025-06-04T04:47:31.286ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 zone_address = fd00:1122:3344:101::2
26612025-06-04T04:47:31.286ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26622025-06-04T04:47:31.286ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa0ba4bb-82f2-46a8-bd21-82031f14ca7f", "content-length": "26", "date": "Wed, 04 Jun 2025 04:47:31 GMT"} })
26632025-06-04T04:47:31.286ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26642025-06-04T04:47:31.288ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36
26652025-06-04T04:47:31.349ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 455.133418ms iteration = 23 status = {}
26662025-06-04T04:47:31.373ZINFOnexus (BackgroundTasks): VPC route manager sled cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
26672025-06-04T04:47:31.373ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26682025-06-04T04:47:31.374ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a883158e-c995-4947-9a9e-f08d5a5e3482", "content-length": "372", "date": "Wed, 04 Jun 2025 04:47:30 GMT"} })
26692025-06-04T04:47:31.374ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26702025-06-04T04:47:31.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26712025-06-04T04:47:31.375ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 481.276575ms iteration = 23 status = null
26722025-06-04T04:47:31.388ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
26732025-06-04T04:47:31.388ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
26742025-06-04T04:47:31.389ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2bd610dc-4acb-44cb-9243-d5711e971db8", "date": "Wed, 04 Jun 2025 04:47:30 GMT"} })
26752025-06-04T04:47:31.389ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26762025-06-04T04:47:31.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26772025-06-04T04:47:31.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38321 req_id = 1bdd21a7-c72c-4b64-84cb-558b0421911e roles = RoleSet { roles: {} } uri = /metrics/collectors/6e958f0b-8d3a-47ee-bfea-40bd8f174cf7/producers?sort_by=id_ascending
26782025-06-04T04:47:31.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38321 req_id = 1bdd21a7-c72c-4b64-84cb-558b0421911e resource = Database result = Ok(()) uri = /metrics/collectors/6e958f0b-8d3a-47ee-bfea-40bd8f174cf7/producers?sort_by=id_ascending
26792025-06-04T04:47:31.515ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
26802025-06-04T04:47:31.515ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb9ea8ff-886a-41df-bae4-d96daad6409a", "content-length": "691", "date": "Wed, 04 Jun 2025 04:47:31 GMT"} })
26812025-06-04T04:47:31.515ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
26822025-06-04T04:47:31.515ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
26832025-06-04T04:47:31.515ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
26842025-06-04T04:47:31.517ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 622.174934ms iteration = 23 status = {}
26852025-06-04T04:47:31.518ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26862025-06-04T04:47:31.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26872025-06-04T04:47:31.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 26057 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38321 req_id = 1bdd21a7-c72c-4b64-84cb-558b0421911e response_code = 200 uri = /metrics/collectors/6e958f0b-8d3a-47ee-bfea-40bd8f174cf7/producers?sort_by=id_ascending
26882025-06-04T04:47:31.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38321 req_id = 604abfcb-9e03-447d-b42f-fb329edcfafc roles = RoleSet { roles: {} } uri = /metrics/collectors/6e958f0b-8d3a-47ee-bfea-40bd8f174cf7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjAzODE5NC0yMDU3LTQ0NmYtOGM2ZS04YjA1YWFlODk3NWQifX0%3D
26892025-06-04T04:47:31.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38321 req_id = 604abfcb-9e03-447d-b42f-fb329edcfafc resource = Database result = Ok(()) uri = /metrics/collectors/6e958f0b-8d3a-47ee-bfea-40bd8f174cf7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjAzODE5NC0yMDU3LTQ0NmYtOGM2ZS04YjA1YWFlODk3NWQifX0%3D
26902025-06-04T04:47:31.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2080 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38321 req_id = 604abfcb-9e03-447d-b42f-fb329edcfafc response_code = 200 uri = /metrics/collectors/6e958f0b-8d3a-47ee-bfea-40bd8f174cf7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjAzODE5NC0yMDU3LTQ0NmYtOGM2ZS04YjA1YWFlODk3NWQifX0%3D
26912025-06-04T04:47:31.521ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26922025-06-04T04:47:31.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26932025-06-04T04:47:31.524ZINFOnexus (BackgroundTasks): VPC route manager sled cb8aa4e2-773a-4f3e-86b7-f32104e9c4de push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
26942025-06-04T04:47:31.524ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26952025-06-04T04:47:31.525ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1fc4f253-c457-493e-8ca4-3680e915697b", "date": "Wed, 04 Jun 2025 04:47:31 GMT"} })
26962025-06-04T04:47:31.527ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 632.409969ms iteration = 23 status = {}
26972025-06-04T04:47:31.530ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
26982025-06-04T04:47:31.564ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
26992025-06-04T04:47:31.564ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b5cfd243-e50d-44b5-8169-4038130f86e5", "date": "Wed, 04 Jun 2025 04:47:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
27002025-06-04T04:47:31.564ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
27012025-06-04T04:47:31.566ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "94a0a3be-3501-4655-b895-fac8223aa9bf", "date": "Wed, 04 Jun 2025 04:47:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
27022025-06-04T04:47:31.566ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
27032025-06-04T04:47:31.567ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
27042025-06-04T04:47:31.567ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 673.023486ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
27052025-06-04T04:47:31.614ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27062025-06-04T04:47:31.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27072025-06-04T04:47:31.616ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
27082025-06-04T04:47:31.616ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "82109647-1de7-4eb3-8533-04b16589fc73", "date": "Wed, 04 Jun 2025 04:47:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
27092025-06-04T04:47:31.616ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
27102025-06-04T04:47:31.617ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: a0769b7e-afb1-46f8-b225-eac4dddfaf8d, rack_id: 5a147cfa-15ac-4bf0-8777-c82b354c8c36, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(913c54af-e122-4277-b509-f8a495f24eae) } rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch_location = Switch0
27112025-06-04T04:47:31.617ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27122025-06-04T04:47:31.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27132025-06-04T04:47:31.618ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "7e53be13-093e-45d5-81da-70a877f1fda3", "date": "Wed, 04 Jun 2025 04:47:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
27142025-06-04T04:47:31.618ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
27152025-06-04T04:47:31.620ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "547d0efb-209d-48db-af10-7ad219eda3df", "date": "Wed, 04 Jun 2025 04:47:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
27162025-06-04T04:47:31.620ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
27172025-06-04T04:47:31.622ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
27182025-06-04T04:47:31.622ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 728.187742ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
27192025-06-04T04:47:31.635ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
27202025-06-04T04:47:31.635ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 913c54af-e122-4277-b509-f8a495f24eae
27212025-06-04T04:47:31.635ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
27222025-06-04T04:47:31.635ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
27232025-06-04T04:47:31.635ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27242025-06-04T04:47:31.635ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27252025-06-04T04:47:31.635ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27262025-06-04T04:47:31.635ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27272025-06-04T04:47:31.636ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27282025-06-04T04:47:31.636ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27292025-06-04T04:47:31.636ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36
27302025-06-04T04:47:31.636ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27312025-06-04T04:47:31.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27322025-06-04T04:47:31.639ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch_location = Switch0
27332025-06-04T04:47:31.639ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
27342025-06-04T04:47:31.739ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2efbbc25-c8eb-4e7a-8f8b-2988aed32517", "date": "Wed, 04 Jun 2025 04:47:30 GMT"} })
27352025-06-04T04:47:31.739ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch = Switch0
27362025-06-04T04:47:31.739ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
27372025-06-04T04:47:31.740ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6992f7d8-b7e0-4c2f-969e-da5397e611d8", "content-length": "682", "date": "Wed, 04 Jun 2025 04:47:31 GMT"} })
27382025-06-04T04:47:31.740ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27392025-06-04T04:47:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27402025-06-04T04:47:31.743ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27412025-06-04T04:47:31.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27422025-06-04T04:47:31.746ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27432025-06-04T04:47:31.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27442025-06-04T04:47:31.749ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27452025-06-04T04:47:31.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27462025-06-04T04:47:31.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 07753a50-df44-475e-b535-2a51f77a623c roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27472025-06-04T04:47:31.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 07753a50-df44-475e-b535-2a51f77a623c resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27482025-06-04T04:47:31.757ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 861.854151ms iteration = 23 status = {}
27492025-06-04T04:47:31.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2358 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 07753a50-df44-475e-b535-2a51f77a623c response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27502025-06-04T04:47:31.788ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 4
27512025-06-04T04:47:31.788ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221
27522025-06-04T04:47:31.818ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
27532025-06-04T04:47:31.819ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:44830
27542025-06-04T04:47:31.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:44830 req_id = 91dd914e-ee59-42d7-b9fa-6d580209c6a5 roles = RoleSet { roles: {} } uri = /metrics/producers
27552025-06-04T04:47:31.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:44830 req_id = 91dd914e-ee59-42d7-b9fa-6d580209c6a5 resource = Database result = Ok(()) uri = /metrics/producers
27562025-06-04T04:47:31.859ZINFOnexus: assigned collector to new producer collector_id = 6e958f0b-8d3a-47ee-bfea-40bd8f174cf7 file = nexus/src/app/oximeter.rs:76 producer_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
27572025-06-04T04:47:31.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 40553 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:44830 req_id = 91dd914e-ee59-42d7-b9fa-6d580209c6a5 response_code = 201 uri = /metrics/producers
27582025-06-04T04:47:31.859ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "91dd914e-ee59-42d7-b9fa-6d580209c6a5", "content-length": "41", "date": "Wed, 04 Jun 2025 04:47:31 GMT"} })
27592025-06-04T04:47:31.860ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
27602025-06-04T04:47:32.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 33131c2e-f680-480e-aebe-81c0fd29dd58 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27612025-06-04T04:47:32.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 33131c2e-f680-480e-aebe-81c0fd29dd58 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27622025-06-04T04:47:32.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2596 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 33131c2e-f680-480e-aebe-81c0fd29dd58 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27632025-06-04T04:47:33.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 6abbaa42-a6c9-4b54-b15b-ef65c9e37367 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27642025-06-04T04:47:33.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 6abbaa42-a6c9-4b54-b15b-ef65c9e37367 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27652025-06-04T04:47:33.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3101 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 6abbaa42-a6c9-4b54-b15b-ef65c9e37367 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27662025-06-04T04:47:34.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 9d52988e-ba3c-4f46-8545-dd0732a2565e roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27672025-06-04T04:47:34.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 9d52988e-ba3c-4f46-8545-dd0732a2565e resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27682025-06-04T04:47:34.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1932 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 9d52988e-ba3c-4f46-8545-dd0732a2565e response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27692025-06-04T04:47:35.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 70d9730b-e019-4723-8656-c77894de3096 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27702025-06-04T04:47:35.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 70d9730b-e019-4723-8656-c77894de3096 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27712025-06-04T04:47:35.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 70d9730b-e019-4723-8656-c77894de3096 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27722025-06-04T04:47:36.505ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 833 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = 4d3f8a2f-9286-4e34-971e-42d5bb501b97 response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
27732025-06-04T04:47:36.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 91f789e3-c227-4798-91e7-091d1086884c roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27742025-06-04T04:47:36.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 91f789e3-c227-4798-91e7-091d1086884c resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27752025-06-04T04:47:36.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3051 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 91f789e3-c227-4798-91e7-091d1086884c response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27762025-06-04T04:47:37.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 1ecbf0ec-13d8-490a-b2eb-9da776d3f64d roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27772025-06-04T04:47:37.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 1ecbf0ec-13d8-490a-b2eb-9da776d3f64d resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27782025-06-04T04:47:37.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2830 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 1ecbf0ec-13d8-490a-b2eb-9da776d3f64d response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27792025-06-04T04:47:38.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c13e1ef2-c6b3-4455-9f9f-4dc9233d99ae roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27802025-06-04T04:47:38.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c13e1ef2-c6b3-4455-9f9f-4dc9233d99ae resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27812025-06-04T04:47:38.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c13e1ef2-c6b3-4455-9f9f-4dc9233d99ae response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27822025-06-04T04:47:39.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 16dab348-3af1-47ff-86bf-da3cb0f78257 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27832025-06-04T04:47:39.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 16dab348-3af1-47ff-86bf-da3cb0f78257 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27842025-06-04T04:47:39.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 16dab348-3af1-47ff-86bf-da3cb0f78257 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27852025-06-04T04:47:40.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
27862025-06-04T04:47:40.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27872025-06-04T04:47:40.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
27882025-06-04T04:47:40.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27892025-06-04T04:47:40.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27902025-06-04T04:47:40.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27912025-06-04T04:47:40.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 4ba51050-b6e9-4a7d-ad72-d9af4bf69168 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27922025-06-04T04:47:40.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 4ba51050-b6e9-4a7d-ad72-d9af4bf69168 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27932025-06-04T04:47:40.897ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27942025-06-04T04:47:40.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27952025-06-04T04:47:40.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27962025-06-04T04:47:40.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1833 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 4ba51050-b6e9-4a7d-ad72-d9af4bf69168 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
27972025-06-04T04:47:40.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27982025-06-04T04:47:40.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27992025-06-04T04:47:40.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28002025-06-04T04:47:40.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28012025-06-04T04:47:40.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28022025-06-04T04:47:40.932ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.967001ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28032025-06-04T04:47:40.942ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28042025-06-04T04:47:40.945ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1dd88a28-32c4-4490-89f2-ae05402d904c, lookup_type: ById(1dd88a28-32c4-4490-89f2-ae05402d904c) } result = Ok(())
28052025-06-04T04:47:40.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28062025-06-04T04:47:40.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28072025-06-04T04:47:40.958ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c original_time_created = 2025-06-04 04:36:14.609521 UTC target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c time_created = 2025-06-04 04:36:14.609521 UTC
28082025-06-04T04:47:40.958ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 62.901705ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","time_created":"2025-06-04T04:36:14.609521Z"}
28092025-06-04T04:47:41.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 39d6018e-777c-4cbe-bae2-b025e2c3b44a roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28102025-06-04T04:47:41.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 39d6018e-777c-4cbe-bae2-b025e2c3b44a resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28112025-06-04T04:47:41.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2476 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 39d6018e-777c-4cbe-bae2-b025e2c3b44a response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28122025-06-04T04:47:42.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5c4ac4ca-e7ce-40e9-afa8-732995c9fe50 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28132025-06-04T04:47:42.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5c4ac4ca-e7ce-40e9-afa8-732995c9fe50 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28142025-06-04T04:47:42.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2484 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5c4ac4ca-e7ce-40e9-afa8-732995c9fe50 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28152025-06-04T04:47:43.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 0ca3c6eb-0121-4fb9-9533-ba56b573b828 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28162025-06-04T04:47:43.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 0ca3c6eb-0121-4fb9-9533-ba56b573b828 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28172025-06-04T04:47:43.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1888 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 0ca3c6eb-0121-4fb9-9533-ba56b573b828 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28182025-06-04T04:47:44.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 908d8755-442f-4927-80d3-b1fc61cfdb08 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28192025-06-04T04:47:44.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 908d8755-442f-4927-80d3-b1fc61cfdb08 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28202025-06-04T04:47:44.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1807 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 908d8755-442f-4927-80d3-b1fc61cfdb08 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28212025-06-04T04:47:45.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 1f7a71a8-aa9f-466a-91ab-55417a7290fc roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28222025-06-04T04:47:45.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 1f7a71a8-aa9f-466a-91ab-55417a7290fc resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28232025-06-04T04:47:45.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1887 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 1f7a71a8-aa9f-466a-91ab-55417a7290fc response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28242025-06-04T04:47:46.505ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 519 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = 38e8bba8-29ce-43bc-9c20-a83ef3683cd5 response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
28252025-06-04T04:47:46.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 0111877f-f280-4471-9a2c-134e3bcdba68 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28262025-06-04T04:47:46.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 0111877f-f280-4471-9a2c-134e3bcdba68 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28272025-06-04T04:47:46.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2018 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 0111877f-f280-4471-9a2c-134e3bcdba68 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28282025-06-04T04:47:48.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 49026fcc-1ad1-44dd-8ce6-527a72e10879 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28292025-06-04T04:47:48.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 49026fcc-1ad1-44dd-8ce6-527a72e10879 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28302025-06-04T04:47:48.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2125 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 49026fcc-1ad1-44dd-8ce6-527a72e10879 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28312025-06-04T04:47:49.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = bf0ab82a-7f94-412e-8d46-178fc36a1df2 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28322025-06-04T04:47:49.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = bf0ab82a-7f94-412e-8d46-178fc36a1df2 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28332025-06-04T04:47:49.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2008 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = bf0ab82a-7f94-412e-8d46-178fc36a1df2 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28342025-06-04T04:47:50.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 52a4a3cd-1a54-4b07-a50f-963720668930 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28352025-06-04T04:47:50.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 52a4a3cd-1a54-4b07-a50f-963720668930 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28362025-06-04T04:47:50.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1603 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 52a4a3cd-1a54-4b07-a50f-963720668930 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28372025-06-04T04:47:50.896ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
28382025-06-04T04:47:50.896ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28392025-06-04T04:47:50.896ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
28402025-06-04T04:47:50.896ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28412025-06-04T04:47:50.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28422025-06-04T04:47:50.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28432025-06-04T04:47:50.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28442025-06-04T04:47:50.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28452025-06-04T04:47:50.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28462025-06-04T04:47:50.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28472025-06-04T04:47:50.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28482025-06-04T04:47:50.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28492025-06-04T04:47:50.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28502025-06-04T04:47:50.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1dd88a28-32c4-4490-89f2-ae05402d904c, lookup_type: ById(1dd88a28-32c4-4490-89f2-ae05402d904c) } result = Ok(())
28512025-06-04T04:47:50.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28522025-06-04T04:47:50.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28532025-06-04T04:47:50.921ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c original_time_created = 2025-06-04 04:36:14.609521 UTC target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c time_created = 2025-06-04 04:36:14.609521 UTC
28542025-06-04T04:47:50.921ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.203843ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","time_created":"2025-06-04T04:36:14.609521Z"}
28552025-06-04T04:47:50.933ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28562025-06-04T04:47:50.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28572025-06-04T04:47:50.965ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.702318ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28582025-06-04T04:47:51.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 875ef15c-a40d-456e-8d70-3362e2bd488b roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28592025-06-04T04:47:51.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 875ef15c-a40d-456e-8d70-3362e2bd488b resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28602025-06-04T04:47:51.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1829 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 875ef15c-a40d-456e-8d70-3362e2bd488b response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28612025-06-04T04:47:52.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 9be30901-1188-495f-98b4-2329a8d9aa56 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28622025-06-04T04:47:52.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 9be30901-1188-495f-98b4-2329a8d9aa56 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28632025-06-04T04:47:52.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2531 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 9be30901-1188-495f-98b4-2329a8d9aa56 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28642025-06-04T04:47:53.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 1ccb9224-8233-40eb-8bca-8581f0578a1e roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28652025-06-04T04:47:53.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 1ccb9224-8233-40eb-8bca-8581f0578a1e resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28662025-06-04T04:47:53.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2118 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 1ccb9224-8233-40eb-8bca-8581f0578a1e response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28672025-06-04T04:47:54.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2e66caee-f0d6-40da-a713-e4f95936d83c roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28682025-06-04T04:47:54.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2e66caee-f0d6-40da-a713-e4f95936d83c resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28692025-06-04T04:47:54.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2433 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2e66caee-f0d6-40da-a713-e4f95936d83c response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28702025-06-04T04:47:55.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 7cf8a171-d822-4ecd-bede-2bb1c28f7089 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28712025-06-04T04:47:55.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 7cf8a171-d822-4ecd-bede-2bb1c28f7089 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28722025-06-04T04:47:55.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2581 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 7cf8a171-d822-4ecd-bede-2bb1c28f7089 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28732025-06-04T04:47:56.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 9d3e8f45-974d-47d3-a279-593e92737adb roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28742025-06-04T04:47:56.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 9d3e8f45-974d-47d3-a279-593e92737adb resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28752025-06-04T04:47:56.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1957 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 9d3e8f45-974d-47d3-a279-593e92737adb response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28762025-06-04T04:47:56.504ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 469 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = 4cf01575-8d89-426a-acfa-b8821742aeb7 response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
28772025-06-04T04:47:57.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c89327e6-0264-4c4f-b68e-2c6f16cfde3d roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28782025-06-04T04:47:57.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c89327e6-0264-4c4f-b68e-2c6f16cfde3d resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28792025-06-04T04:47:57.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3443 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c89327e6-0264-4c4f-b68e-2c6f16cfde3d response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28802025-06-04T04:47:58.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = b7540812-e15a-4ad9-8b98-e4f16abe824e roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28812025-06-04T04:47:58.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = b7540812-e15a-4ad9-8b98-e4f16abe824e resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28822025-06-04T04:47:58.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2611 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = b7540812-e15a-4ad9-8b98-e4f16abe824e response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28832025-06-04T04:47:59.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 1d8bb4f9-4279-4566-accc-90ba0e465962 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28842025-06-04T04:47:59.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 1d8bb4f9-4279-4566-accc-90ba0e465962 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28852025-06-04T04:47:59.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1597 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 1d8bb4f9-4279-4566-accc-90ba0e465962 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28862025-06-04T04:48:00.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c497ba56-79a3-4494-971d-92a3776a29cb roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28872025-06-04T04:48:00.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c497ba56-79a3-4494-971d-92a3776a29cb resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28882025-06-04T04:48:00.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2158 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c497ba56-79a3-4494-971d-92a3776a29cb response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
28892025-06-04T04:48:00.894ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
28902025-06-04T04:48:00.894ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28912025-06-04T04:48:00.894ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
28922025-06-04T04:48:00.894ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
28932025-06-04T04:48:00.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28942025-06-04T04:48:00.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
28952025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
28962025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
28972025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28982025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
28992025-06-04T04:48:00.895ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
29002025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29012025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29022025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
29032025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29042025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
29052025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
29062025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
29072025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29082025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29092025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
29102025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
29112025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
29122025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29132025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29142025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 24 reason = Timeout
29152025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29162025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
29172025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
29182025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29192025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29202025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29212025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29222025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29232025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29242025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29252025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29262025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
29272025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29282025-06-04T04:48:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29292025-06-04T04:48:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29302025-06-04T04:48:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29312025-06-04T04:48:00.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
29322025-06-04T04:48:00.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
29332025-06-04T04:48:00.896ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 24 reason = Timeout
29342025-06-04T04:48:00.896ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
29352025-06-04T04:48:00.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
29362025-06-04T04:48:00.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
29372025-06-04T04:48:00.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29382025-06-04T04:48:00.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29392025-06-04T04:48:00.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
29402025-06-04T04:48:00.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
29412025-06-04T04:48:00.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
29422025-06-04T04:48:00.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29432025-06-04T04:48:00.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
29442025-06-04T04:48:00.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29452025-06-04T04:48:00.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
29462025-06-04T04:48:00.897ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1505, tv_nsec: 62228184 } })
29472025-06-04T04:48:00.897ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
29482025-06-04T04:48:00.897ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1505, tv_nsec: 62882774 } })
29492025-06-04T04:48:00.898ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
29502025-06-04T04:48:00.899ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29512025-06-04T04:48:00.899ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29522025-06-04T04:48:00.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29532025-06-04T04:48:00.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29542025-06-04T04:48:00.900ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.664441ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
29552025-06-04T04:48:00.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29562025-06-04T04:48:00.901ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29572025-06-04T04:48:00.901ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29582025-06-04T04:48:00.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
29592025-06-04T04:48:00.902ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29602025-06-04T04:48:00.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29612025-06-04T04:48:00.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29622025-06-04T04:48:00.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
29632025-06-04T04:48:00.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29642025-06-04T04:48:00.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29652025-06-04T04:48:00.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29662025-06-04T04:48:00.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29672025-06-04T04:48:00.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29682025-06-04T04:48:00.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29692025-06-04T04:48:00.911ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29702025-06-04T04:48:00.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29712025-06-04T04:48:00.913ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29722025-06-04T04:48:00.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29732025-06-04T04:48:00.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29742025-06-04T04:48:00.915ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29752025-06-04T04:48:00.915ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1505, tv_nsec: 80828346 } })
29762025-06-04T04:48:00.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29772025-06-04T04:48:00.916ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36
29782025-06-04T04:48:00.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29792025-06-04T04:48:00.917ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29802025-06-04T04:48:00.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29812025-06-04T04:48:00.947ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29822025-06-04T04:48:00.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29832025-06-04T04:48:00.950ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 54.825032ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
29842025-06-04T04:48:00.950ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29852025-06-04T04:48:00.950ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
29862025-06-04T04:48:00.950ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29872025-06-04T04:48:00.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29882025-06-04T04:48:00.955ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29892025-06-04T04:48:00.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29902025-06-04T04:48:00.957ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 60.389446ms iteration = 24 status = {"errors":[],"requests_created_ok":[]}
29912025-06-04T04:48:00.960ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29922025-06-04T04:48:00.960ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29932025-06-04T04:48:00.960ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 64.047422ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
29942025-06-04T04:48:00.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29952025-06-04T04:48:00.962ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
29962025-06-04T04:48:00.962ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29972025-06-04T04:48:00.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
29982025-06-04T04:48:00.964ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29992025-06-04T04:48:00.964ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30002025-06-04T04:48:00.966ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
30012025-06-04T04:48:00.966ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30022025-06-04T04:48:00.966ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 70.125395ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
30032025-06-04T04:48:00.967ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30042025-06-04T04:48:00.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30052025-06-04T04:48:00.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30062025-06-04T04:48:00.967ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30072025-06-04T04:48:00.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30082025-06-04T04:48:00.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30092025-06-04T04:48:00.968ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 73.190101ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30102025-06-04T04:48:00.970ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30112025-06-04T04:48:00.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30122025-06-04T04:48:00.971ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30132025-06-04T04:48:00.973ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30142025-06-04T04:48:00.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30152025-06-04T04:48:00.973ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30162025-06-04T04:48:00.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30172025-06-04T04:48:00.976ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1dd88a28-32c4-4490-89f2-ae05402d904c, lookup_type: ById(1dd88a28-32c4-4490-89f2-ae05402d904c) } result = Ok(())
30182025-06-04T04:48:00.976ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30192025-06-04T04:48:00.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30202025-06-04T04:48:01.002ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
30212025-06-04T04:48:01.002ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30222025-06-04T04:48:01.002ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e62dad04-a037-4d83-8f29-e34ee9fc73fa", "content-length": "26", "date": "Wed, 04 Jun 2025 04:48:00 GMT"} })
30232025-06-04T04:48:01.002ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30242025-06-04T04:48:01.002ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
30252025-06-04T04:48:01.002ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30262025-06-04T04:48:01.003ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1baeda8-10b5-4352-8a0a-3af5233f7007", "content-length": "26", "date": "Wed, 04 Jun 2025 04:48:00 GMT"} })
30272025-06-04T04:48:01.003ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30282025-06-04T04:48:01.004ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30292025-06-04T04:48:01.005ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30302025-06-04T04:48:01.005ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30312025-06-04T04:48:01.006ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
30322025-06-04T04:48:01.006ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30332025-06-04T04:48:01.006ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
30342025-06-04T04:48:01.006ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30352025-06-04T04:48:01.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
30362025-06-04T04:48:01.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30372025-06-04T04:48:01.008ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cb8aa4e2-773a-4f3e-86b7-f32104e9c4de, lookup_type: ById(cb8aa4e2-773a-4f3e-86b7-f32104e9c4de) } result = Ok(())
30382025-06-04T04:48:01.008ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30392025-06-04T04:48:01.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30402025-06-04T04:48:01.012ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30412025-06-04T04:48:01.013ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
30422025-06-04T04:48:01.013ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 117.592875ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
30432025-06-04T04:48:01.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30442025-06-04T04:48:01.016ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 zone_address = fd00:1122:3344:101::2
30452025-06-04T04:48:01.016ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30462025-06-04T04:48:01.016ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "137a3955-7359-4f37-b4ee-d93a722a895d", "content-length": "26", "date": "Wed, 04 Jun 2025 04:48:00 GMT"} })
30472025-06-04T04:48:01.017ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30482025-06-04T04:48:01.018ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36
30492025-06-04T04:48:01.019ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 122.496759ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30502025-06-04T04:48:01.051ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30512025-06-04T04:48:01.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30522025-06-04T04:48:01.082ZINFOnexus (BackgroundTasks): VPC route manager sled cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
30532025-06-04T04:48:01.082ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30542025-06-04T04:48:01.085ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30552025-06-04T04:48:01.086ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 190.865817ms iteration = 24 status = 0
30562025-06-04T04:48:01.087ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
30572025-06-04T04:48:01.087ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
30582025-06-04T04:48:01.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
30592025-06-04T04:48:01.089ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a326ce44-cb77-4473-9d7a-c6f820de8ed7", "content-length": "372", "date": "Wed, 04 Jun 2025 04:48:00 GMT"} })
30602025-06-04T04:48:01.089ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30612025-06-04T04:48:01.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30622025-06-04T04:48:01.093ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c original_time_created = 2025-06-04 04:36:14.609521 UTC target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c time_created = 2025-06-04 04:36:14.609521 UTC
30632025-06-04T04:48:01.093ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 198.434842ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","time_created":"2025-06-04T04:36:14.609521Z"}
30642025-06-04T04:48:01.117ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30652025-06-04T04:48:01.117ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
30662025-06-04T04:48:01.117ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 222.326535ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
30672025-06-04T04:48:01.122ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 225.291309ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
30682025-06-04T04:48:01.126ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
30692025-06-04T04:48:01.126ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 231.041437ms iteration = 24 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
30702025-06-04T04:48:01.142ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
30712025-06-04T04:48:01.142ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
30722025-06-04T04:48:01.142ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9e7d3d2b-2c6a-49cd-b8e2-b8d929fc6d92", "date": "Wed, 04 Jun 2025 04:48:00 GMT"} })
30732025-06-04T04:48:01.142ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30742025-06-04T04:48:01.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30752025-06-04T04:48:01.145ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30762025-06-04T04:48:01.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30772025-06-04T04:48:01.148ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30782025-06-04T04:48:01.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30792025-06-04T04:48:01.152ZINFOnexus (BackgroundTasks): VPC route manager sled cb8aa4e2-773a-4f3e-86b7-f32104e9c4de push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
30802025-06-04T04:48:01.152ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30812025-06-04T04:48:01.153ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4ef7fcde-76d9-46e5-ac35-d04802c1c5cd", "date": "Wed, 04 Jun 2025 04:48:00 GMT"} })
30822025-06-04T04:48:01.154ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 259.182194ms iteration = 24 status = {}
30832025-06-04T04:48:01.193ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 298.002053ms iteration = 27 status = {"physical_disks_added":0}
30842025-06-04T04:48:01.197ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30852025-06-04T04:48:01.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30862025-06-04T04:48:01.198ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30872025-06-04T04:48:01.200ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30882025-06-04T04:48:01.200ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30892025-06-04T04:48:01.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30902025-06-04T04:48:01.202ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30912025-06-04T04:48:01.204ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30922025-06-04T04:48:01.204ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30932025-06-04T04:48:01.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30942025-06-04T04:48:01.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 0eacea36-8442-42ee-b041-50d513c4294c roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
30952025-06-04T04:48:01.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 0eacea36-8442-42ee-b041-50d513c4294c resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
30962025-06-04T04:48:01.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 0eacea36-8442-42ee-b041-50d513c4294c response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
30972025-06-04T04:48:01.297ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 403.24768ms iteration = 24 status = {}
30982025-06-04T04:48:01.304ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30992025-06-04T04:48:01.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31002025-06-04T04:48:01.306ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 412.44586ms iteration = 24 status = null
31012025-06-04T04:48:01.340ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
31022025-06-04T04:48:01.340ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "09ee76bf-d031-4e28-969f-7a8b421a4db7", "content-length": "691", "date": "Wed, 04 Jun 2025 04:48:00 GMT"} })
31032025-06-04T04:48:01.340ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
31042025-06-04T04:48:01.340ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
31052025-06-04T04:48:01.340ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
31062025-06-04T04:48:01.341ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 446.05354ms iteration = 24 status = {}
31072025-06-04T04:48:01.382ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31082025-06-04T04:48:01.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31092025-06-04T04:48:01.385ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: a0769b7e-afb1-46f8-b225-eac4dddfaf8d, rack_id: 5a147cfa-15ac-4bf0-8777-c82b354c8c36, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(913c54af-e122-4277-b509-f8a495f24eae) } rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch_location = Switch0
31102025-06-04T04:48:01.385ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31112025-06-04T04:48:01.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31122025-06-04T04:48:01.398ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
31132025-06-04T04:48:01.398ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 913c54af-e122-4277-b509-f8a495f24eae
31142025-06-04T04:48:01.398ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
31152025-06-04T04:48:01.398ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
31162025-06-04T04:48:01.398ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31172025-06-04T04:48:01.398ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31182025-06-04T04:48:01.398ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31192025-06-04T04:48:01.398ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
31202025-06-04T04:48:01.398ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31212025-06-04T04:48:01.398ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
31222025-06-04T04:48:01.398ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36
31232025-06-04T04:48:01.398ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31242025-06-04T04:48:01.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31252025-06-04T04:48:01.401ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch_location = Switch0
31262025-06-04T04:48:01.401ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
31272025-06-04T04:48:01.515ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cf23bc53-e077-41c2-8623-e253ef6beddd", "date": "Wed, 04 Jun 2025 04:48:00 GMT"} })
31282025-06-04T04:48:01.515ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch = Switch0
31292025-06-04T04:48:01.515ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
31302025-06-04T04:48:01.516ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "870f06f3-d6cf-4d08-be11-7cf0870c79df", "content-length": "682", "date": "Wed, 04 Jun 2025 04:48:01 GMT"} })
31312025-06-04T04:48:01.516ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31322025-06-04T04:48:01.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31332025-06-04T04:48:01.520ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31342025-06-04T04:48:01.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31352025-06-04T04:48:01.524ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31362025-06-04T04:48:01.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31372025-06-04T04:48:01.526ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31382025-06-04T04:48:01.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31392025-06-04T04:48:01.533ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 637.704509ms iteration = 24 status = {}
31402025-06-04T04:48:02.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = a820e8c6-70db-4331-882b-164833060124 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31412025-06-04T04:48:02.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = a820e8c6-70db-4331-882b-164833060124 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31422025-06-04T04:48:02.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1565 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = a820e8c6-70db-4331-882b-164833060124 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31432025-06-04T04:48:03.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 1285c15d-eed6-4b8b-be72-e679a7add4cf roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31442025-06-04T04:48:03.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 1285c15d-eed6-4b8b-be72-e679a7add4cf resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31452025-06-04T04:48:03.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3001 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 1285c15d-eed6-4b8b-be72-e679a7add4cf response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31462025-06-04T04:48:04.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 38690d6a-87c7-488d-9b68-d29617ea6a95 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31472025-06-04T04:48:04.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 38690d6a-87c7-488d-9b68-d29617ea6a95 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31482025-06-04T04:48:04.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2102 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 38690d6a-87c7-488d-9b68-d29617ea6a95 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31492025-06-04T04:48:05.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = a9673aed-c11d-4eec-b297-1ea7fc58b320 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31502025-06-04T04:48:05.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = a9673aed-c11d-4eec-b297-1ea7fc58b320 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31512025-06-04T04:48:05.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = a9673aed-c11d-4eec-b297-1ea7fc58b320 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31522025-06-04T04:48:06.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 731bcdc7-e568-4123-acab-67b5989ff7fb roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31532025-06-04T04:48:06.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 731bcdc7-e568-4123-acab-67b5989ff7fb resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31542025-06-04T04:48:06.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2180 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 731bcdc7-e568-4123-acab-67b5989ff7fb response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31552025-06-04T04:48:06.505ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 529 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = 53ad372c-608d-4fd2-a825-4014d08732d4 response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
31562025-06-04T04:48:07.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 93e94fe4-315a-4961-9e9c-6701e4ce88d8 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31572025-06-04T04:48:07.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 93e94fe4-315a-4961-9e9c-6701e4ce88d8 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31582025-06-04T04:48:07.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2452 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 93e94fe4-315a-4961-9e9c-6701e4ce88d8 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31592025-06-04T04:48:08.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 58012329-ad69-4e49-9b04-6a49da0e4998 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31602025-06-04T04:48:08.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 58012329-ad69-4e49-9b04-6a49da0e4998 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31612025-06-04T04:48:08.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2351 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 58012329-ad69-4e49-9b04-6a49da0e4998 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31622025-06-04T04:48:09.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 6511eaf7-53ec-4449-9e52-b9c4988bf7dc roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31632025-06-04T04:48:09.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 6511eaf7-53ec-4449-9e52-b9c4988bf7dc resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31642025-06-04T04:48:09.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2582 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 6511eaf7-53ec-4449-9e52-b9c4988bf7dc response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31652025-06-04T04:48:10.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = a93208d1-15f4-4a1d-8f05-c93d0cece1b4 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31662025-06-04T04:48:10.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = a93208d1-15f4-4a1d-8f05-c93d0cece1b4 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31672025-06-04T04:48:10.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = a93208d1-15f4-4a1d-8f05-c93d0cece1b4 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31682025-06-04T04:48:10.896ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
31692025-06-04T04:48:10.896ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
31702025-06-04T04:48:10.896ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31712025-06-04T04:48:10.896ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31722025-06-04T04:48:10.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31732025-06-04T04:48:10.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31742025-06-04T04:48:10.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31752025-06-04T04:48:10.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31762025-06-04T04:48:10.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31772025-06-04T04:48:10.900ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.675271ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31782025-06-04T04:48:10.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31792025-06-04T04:48:10.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31802025-06-04T04:48:10.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31812025-06-04T04:48:10.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31822025-06-04T04:48:10.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31832025-06-04T04:48:10.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31842025-06-04T04:48:10.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1dd88a28-32c4-4490-89f2-ae05402d904c, lookup_type: ById(1dd88a28-32c4-4490-89f2-ae05402d904c) } result = Ok(())
31852025-06-04T04:48:10.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31862025-06-04T04:48:10.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31872025-06-04T04:48:10.919ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c original_time_created = 2025-06-04 04:36:14.609521 UTC target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c time_created = 2025-06-04 04:36:14.609521 UTC
31882025-06-04T04:48:10.919ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.389124ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","time_created":"2025-06-04T04:36:14.609521Z"}
31892025-06-04T04:48:11.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = e343a925-093b-4168-8491-07fdc61b042d roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31902025-06-04T04:48:11.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = e343a925-093b-4168-8491-07fdc61b042d resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31912025-06-04T04:48:11.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1811 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = e343a925-093b-4168-8491-07fdc61b042d response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31922025-06-04T04:48:12.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5bfd346e-82f3-4aca-9ce9-82d8d1997df2 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31932025-06-04T04:48:12.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5bfd346e-82f3-4aca-9ce9-82d8d1997df2 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31942025-06-04T04:48:12.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5bfd346e-82f3-4aca-9ce9-82d8d1997df2 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31952025-06-04T04:48:13.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = d89a8ff2-9cc9-4298-8e0c-ef58ca242d9d roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31962025-06-04T04:48:13.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = d89a8ff2-9cc9-4298-8e0c-ef58ca242d9d resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31972025-06-04T04:48:13.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2366 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = d89a8ff2-9cc9-4298-8e0c-ef58ca242d9d response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
31982025-06-04T04:48:14.476ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b3d5b221-76e9-4917-b9db-ebd62a013ad0 remote_addr = [fd00:1122:3344:101::1]:59961 req_id = cbb2b397-007e-4110-98b8-96bb448f8054 uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-06-04T04:48:14.450819222Z }
31992025-06-04T04:48:14.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59961 req_id = cbb2b397-007e-4110-98b8-96bb448f8054 roles = RoleSet { roles: {} } uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0
32002025-06-04T04:48:14.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59961 req_id = cbb2b397-007e-4110-98b8-96bb448f8054 resource = Database result = Ok(()) uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0
32012025-06-04T04:48:14.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 39047 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59961 req_id = cbb2b397-007e-4110-98b8-96bb448f8054 response_code = 204 uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0
32022025-06-04T04:48:14.490ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b3d5b221-76e9-4917-b9db-ebd62a013ad0 remote_addr = [fd00:1122:3344:101::1]:59961 req_id = caf9ffa5-10f3-497f-acd9-34629b4ec133 uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-06-04T04:48:14.490521845Z }
32032025-06-04T04:48:14.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59961 req_id = caf9ffa5-10f3-497f-acd9-34629b4ec133 roles = RoleSet { roles: {} } uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0
32042025-06-04T04:48:14.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59961 req_id = caf9ffa5-10f3-497f-acd9-34629b4ec133 resource = Database result = Ok(()) uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0
32052025-06-04T04:48:14.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 44294 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59961 req_id = caf9ffa5-10f3-497f-acd9-34629b4ec133 response_code = 204 uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0
32062025-06-04T04:48:15.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = fe511faf-8e8b-4142-a102-58ecb5282fe5 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32072025-06-04T04:48:15.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = fe511faf-8e8b-4142-a102-58ecb5282fe5 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32082025-06-04T04:48:15.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = fe511faf-8e8b-4142-a102-58ecb5282fe5 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32092025-06-04T04:48:16.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 46a5834e-53b1-422a-aa5a-fbeff144028f roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32102025-06-04T04:48:16.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 46a5834e-53b1-422a-aa5a-fbeff144028f resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32112025-06-04T04:48:16.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2435 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 46a5834e-53b1-422a-aa5a-fbeff144028f response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32122025-06-04T04:48:16.505ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 656 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = c0aeff5d-6210-40e1-8ba4-3db907765b7f response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
32132025-06-04T04:48:17.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 09837d5a-8622-4561-8fa7-0e12bef39dc2 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32142025-06-04T04:48:17.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 09837d5a-8622-4561-8fa7-0e12bef39dc2 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32152025-06-04T04:48:17.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1881 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 09837d5a-8622-4561-8fa7-0e12bef39dc2 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32162025-06-04T04:48:18.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = cebd065d-d282-4af9-82c8-e7fead77d67b roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32172025-06-04T04:48:18.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = cebd065d-d282-4af9-82c8-e7fead77d67b resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32182025-06-04T04:48:18.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2576 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = cebd065d-d282-4af9-82c8-e7fead77d67b response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32192025-06-04T04:48:19.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = ed453dc9-1930-4bfe-90a8-fd989e958e5c roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32202025-06-04T04:48:19.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = ed453dc9-1930-4bfe-90a8-fd989e958e5c resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32212025-06-04T04:48:19.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = ed453dc9-1930-4bfe-90a8-fd989e958e5c response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32222025-06-04T04:48:20.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = b620dc80-3ee2-4ef4-a972-95134a286003 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32232025-06-04T04:48:20.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = b620dc80-3ee2-4ef4-a972-95134a286003 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32242025-06-04T04:48:20.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2044 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = b620dc80-3ee2-4ef4-a972-95134a286003 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32252025-06-04T04:48:20.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
32262025-06-04T04:48:20.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
32272025-06-04T04:48:20.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32282025-06-04T04:48:20.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32292025-06-04T04:48:20.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32302025-06-04T04:48:20.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32312025-06-04T04:48:20.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32322025-06-04T04:48:20.898ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32332025-06-04T04:48:20.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32342025-06-04T04:48:20.900ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.951645ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32352025-06-04T04:48:20.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32362025-06-04T04:48:20.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32372025-06-04T04:48:20.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32382025-06-04T04:48:20.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32392025-06-04T04:48:20.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32402025-06-04T04:48:20.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32412025-06-04T04:48:20.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1dd88a28-32c4-4490-89f2-ae05402d904c, lookup_type: ById(1dd88a28-32c4-4490-89f2-ae05402d904c) } result = Ok(())
32422025-06-04T04:48:20.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32432025-06-04T04:48:20.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32442025-06-04T04:48:20.918ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c original_time_created = 2025-06-04 04:36:14.609521 UTC target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c time_created = 2025-06-04 04:36:14.609521 UTC
32452025-06-04T04:48:20.918ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.638914ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","time_created":"2025-06-04T04:36:14.609521Z"}
32462025-06-04T04:48:21.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 27f60a7d-2c87-4105-aca2-690f70e8beb4 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32472025-06-04T04:48:21.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 27f60a7d-2c87-4105-aca2-690f70e8beb4 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32482025-06-04T04:48:21.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2503 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 27f60a7d-2c87-4105-aca2-690f70e8beb4 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32492025-06-04T04:48:22.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c4f4abfa-b816-4866-98a5-cbe32c575657 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32502025-06-04T04:48:22.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c4f4abfa-b816-4866-98a5-cbe32c575657 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32512025-06-04T04:48:22.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c4f4abfa-b816-4866-98a5-cbe32c575657 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32522025-06-04T04:48:23.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5680b9ff-8f9b-4aff-ba9a-fc23ce00ce11 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32532025-06-04T04:48:23.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5680b9ff-8f9b-4aff-ba9a-fc23ce00ce11 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32542025-06-04T04:48:23.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2525 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5680b9ff-8f9b-4aff-ba9a-fc23ce00ce11 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32552025-06-04T04:48:24.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 7c30c496-5724-4bb8-8ad2-ed4763d4cead roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32562025-06-04T04:48:24.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 7c30c496-5724-4bb8-8ad2-ed4763d4cead resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32572025-06-04T04:48:24.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2387 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 7c30c496-5724-4bb8-8ad2-ed4763d4cead response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32582025-06-04T04:48:25.085ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b3d5b221-76e9-4917-b9db-ebd62a013ad0 remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5c3c4d35-9dae-433f-93ec-2c4352553a98 uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-06-04T04:48:25.084849083Z }
32592025-06-04T04:48:25.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5c3c4d35-9dae-433f-93ec-2c4352553a98 roles = RoleSet { roles: {} } uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0
32602025-06-04T04:48:25.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5c3c4d35-9dae-433f-93ec-2c4352553a98 resource = Database result = Ok(()) uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0
32612025-06-04T04:48:25.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 16301 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5c3c4d35-9dae-433f-93ec-2c4352553a98 response_code = 204 uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0
32622025-06-04T04:48:25.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = b862a8c0-7ee3-4211-9623-dcd78e17d1d9 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32632025-06-04T04:48:25.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = b862a8c0-7ee3-4211-9623-dcd78e17d1d9 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32642025-06-04T04:48:25.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2517 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = b862a8c0-7ee3-4211-9623-dcd78e17d1d9 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32652025-06-04T04:48:26.511ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 498 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = 9d7c2e69-45b3-480e-962e-b5809ffbf3cc response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
32662025-06-04T04:48:26.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 526af6f5-2823-4cf5-acb5-046a172cc6ff roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32672025-06-04T04:48:26.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 526af6f5-2823-4cf5-acb5-046a172cc6ff resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32682025-06-04T04:48:26.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1929 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 526af6f5-2823-4cf5-acb5-046a172cc6ff response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
32692025-06-04T04:48:27.488ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b3d5b221-76e9-4917-b9db-ebd62a013ad0 remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 70be43e1-0b3d-4983-8e03-19474865ede2 uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-06-04T04:48:25.101610317Z }
32702025-06-04T04:48:27.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 70be43e1-0b3d-4983-8e03-19474865ede2 roles = RoleSet { roles: {} } uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0
32712025-06-04T04:48:27.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 70be43e1-0b3d-4983-8e03-19474865ede2 resource = Database result = Ok(()) uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0
32722025-06-04T04:48:27.497ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = b3d5b221-76e9-4917-b9db-ebd62a013ad0 remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 70be43e1-0b3d-4983-8e03-19474865ede2 uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0 vmm_needs_update = true
32732025-06-04T04:48:27.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 70be43e1-0b3d-4983-8e03-19474865ede2 roles = RoleSet { roles: {} } uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0
32742025-06-04T04:48:27.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 70be43e1-0b3d-4983-8e03-19474865ede2 resource = Database result = Ok(()) uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0
32752025-06-04T04:48:27.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 70be43e1-0b3d-4983-8e03-19474865ede2 roles = RoleSet { roles: {} } uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0
32762025-06-04T04:48:27.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 70be43e1-0b3d-4983-8e03-19474865ede2 resource = Database result = Ok(()) uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0
32772025-06-04T04:48:27.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 70be43e1-0b3d-4983-8e03-19474865ede2 roles = RoleSet { roles: {} } uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0
32782025-06-04T04:48:27.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 70be43e1-0b3d-4983-8e03-19474865ede2 resource = Database result = Ok(()) uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0
32792025-06-04T04:48:27.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 70be43e1-0b3d-4983-8e03-19474865ede2 roles = RoleSet { roles: {} } uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0
32802025-06-04T04:48:27.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 70be43e1-0b3d-4983-8e03-19474865ede2 resource = Database result = Ok(()) uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0
32812025-06-04T04:48:27.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 70be43e1-0b3d-4983-8e03-19474865ede2 roles = RoleSet { roles: {} } uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0
32822025-06-04T04:48:27.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 70be43e1-0b3d-4983-8e03-19474865ede2 resource = Database result = Ok(()) uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0
32832025-06-04T04:48:27.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 70be43e1-0b3d-4983-8e03-19474865ede2 roles = RoleSet { roles: {} } uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0
32842025-06-04T04:48:27.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 70be43e1-0b3d-4983-8e03-19474865ede2 resource = Database result = Ok(()) uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0
32852025-06-04T04:48:27.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 70be43e1-0b3d-4983-8e03-19474865ede2 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0
32862025-06-04T04:48:27.512ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 70be43e1-0b3d-4983-8e03-19474865ede2 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 6ac9285f-aca7-426a-86f8-a677f8a85ac2, lookup_type: ById(6ac9285f-aca7-426a-86f8-a677f8a85ac2) }, key: 83f572ea-14e0-4788-80cd-26087610a840, lookup_type: ById(83f572ea-14e0-4788-80cd-26087610a840) }, key: 0dedbfa2-e364-4020-81d0-6a05554f570b, lookup_type: ById(0dedbfa2-e364-4020-81d0-6a05554f570b) } result = Ok(()) uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0
32872025-06-04T04:48:27.524ZINFOnexus (dropshot_internal): starting update saga for 0dedbfa2-e364-4020-81d0-6a05554f570b actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1603 instance_id = 0dedbfa2-e364-4020-81d0-6a05554f570b local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 70be43e1-0b3d-4983-8e03-19474865ede2 uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-06-04T04:48:25.101610317Z }
32882025-06-04T04:48:27.524ZDEBGnexus (dropshot_internal): preparing instance-update saga for 0dedbfa2-e364-4020-81d0-6a05554f570b... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 0dedbfa2-e364-4020-81d0-6a05554f570b local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 70be43e1-0b3d-4983-8e03-19474865ede2 uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0
32892025-06-04T04:48:27.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 36152 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 70be43e1-0b3d-4983-8e03-19474865ede2 response_code = 204 uri = /vmms/b3d5b221-76e9-4917-b9db-ebd62a013ad0
32902025-06-04T04:48:27.524ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update
32912025-06-04T04:48:27.524ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"0dedbfa2-e364-4020-81d0-6a05554f570b","lookup_type":{"ById":"0dedbfa2-e364-4020-81d0-6a05554f570b"},"parent":{"key":"83f572ea-14e0-4788-80cd-26087610a840","lookup_type":{"ById":"83f572ea-14e0-4788-80cd-26087610a840"},"parent":{"key":"6ac9285f-aca7-426a-86f8-a677f8a85ac2","lookup_type":{"ById":"6ac9285f-aca7-426a-86f8-a677f8a85ac2"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
32922025-06-04T04:48:27.524ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update
32932025-06-04T04:48:27.569ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update
32942025-06-04T04:48:27.569ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
32952025-06-04T04:48:27.569ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
32962025-06-04T04:48:27.569ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15
32972025-06-04T04:48:27.574ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
32982025-06-04T04:48:27.574ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15
32992025-06-04T04:48:27.577ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
33002025-06-04T04:48:27.577ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15
33012025-06-04T04:48:27.583ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
33022025-06-04T04:48:27.583ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("4270b652-82fe-4ee5-bce7-633320104538")) node_id = 0 saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15
33032025-06-04T04:48:27.586ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
33042025-06-04T04:48:27.586ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15
33052025-06-04T04:48:27.605ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 0dedbfa2-e364-4020-81d0-6a05554f570b saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update
33062025-06-04T04:48:27.607ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = LockInstance
33072025-06-04T04:48:27.607ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = LockInstance
33082025-06-04T04:48:27.610ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = LockInstance
33092025-06-04T04:48:27.610ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = LockInstance
33102025-06-04T04:48:27.612ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = LockInstance
33112025-06-04T04:48:27.612ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = LockInstance
33122025-06-04T04:48:27.614ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = LockInstance
33132025-06-04T04:48:27.614ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = LockInstance
33142025-06-04T04:48:27.616ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = LockInstance
33152025-06-04T04:48:27.616ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = LockInstance
33162025-06-04T04:48:27.617ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = LockInstance
33172025-06-04T04:48:27.618ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = LockInstance
33182025-06-04T04:48:27.619ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = LockInstance
33192025-06-04T04:48:27.622ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 6ac9285f-aca7-426a-86f8-a677f8a85ac2, lookup_type: ById(6ac9285f-aca7-426a-86f8-a677f8a85ac2) }, key: 83f572ea-14e0-4788-80cd-26087610a840, lookup_type: ById(83f572ea-14e0-4788-80cd-26087610a840) }, key: 0dedbfa2-e364-4020-81d0-6a05554f570b, lookup_type: ById(0dedbfa2-e364-4020-81d0-6a05554f570b) } result = Ok(()) saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = LockInstance
33202025-06-04T04:48:27.622ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 0dedbfa2-e364-4020-81d0-6a05554f570b saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = LockInstance updater_id = 4270b652-82fe-4ee5-bce7-633320104538
33212025-06-04T04:48:27.622ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = LockInstance
33222025-06-04T04:48:27.622ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = LockInstance
33232025-06-04T04:48:27.641ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 0dedbfa2-e364-4020-81d0-6a05554f570b saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = LockInstance updater_id = 4270b652-82fe-4ee5-bce7-633320104538
33242025-06-04T04:48:27.641ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = LockInstance
33252025-06-04T04:48:27.641ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = LockInstance
33262025-06-04T04:48:27.645ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 0dedbfa2-e364-4020-81d0-6a05554f570b locked_gen = Generation(Generation(2)) saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = LockInstance updater_id = 4270b652-82fe-4ee5-bce7-633320104538
33272025-06-04T04:48:27.650ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
33282025-06-04T04:48:27.650ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("4270b652-82fe-4ee5-bce7-633320104538")}) node_id = 1 saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15
33292025-06-04T04:48:27.654ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
33302025-06-04T04:48:27.654ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15
33312025-06-04T04:48:27.662ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
33322025-06-04T04:48:27.662ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
33332025-06-04T04:48:27.664ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
33342025-06-04T04:48:27.664ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
33352025-06-04T04:48:27.665ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
33362025-06-04T04:48:27.665ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
33372025-06-04T04:48:27.667ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
33382025-06-04T04:48:27.670ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 6ac9285f-aca7-426a-86f8-a677f8a85ac2, lookup_type: ById(6ac9285f-aca7-426a-86f8-a677f8a85ac2) }, key: 83f572ea-14e0-4788-80cd-26087610a840, lookup_type: ById(83f572ea-14e0-4788-80cd-26087610a840) }, key: 0dedbfa2-e364-4020-81d0-6a05554f570b, lookup_type: ById(0dedbfa2-e364-4020-81d0-6a05554f570b) } result = Ok(()) saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
33392025-06-04T04:48:27.670ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
33402025-06-04T04:48:27.670ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
33412025-06-04T04:48:27.679ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: b3d5b221-76e9-4917-b9db-ebd62a013ad0, time_created: 2025-06-04T04:48:06.506962Z, time_deleted: None, instance_id: 0dedbfa2-e364-4020-81d0-6a05554f570b, sled_id: cb8aa4e2-773a-4f3e-86b7-f32104e9c4de, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-06-04T04:48:25.101610Z, gen: Generation(Generation(7)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-06-04T04:48:04.402153Z, gen: Generation(Generation(3)), propolis_id: Some(b3d5b221-76e9-4917-b9db-ebd62a013ad0), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 0dedbfa2-e364-4020-81d0-6a05554f570b saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(b3d5b221-76e9-4917-b9db-ebd62a013ad0 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-06-04T04:48:27.679053097Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
33422025-06-04T04:48:27.681ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update
33432025-06-04T04:48:27.681ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"0dedbfa2-e364-4020-81d0-6a05554f570b","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"b3d5b221-76e9-4917-b9db-ebd62a013ad0"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"0dedbfa2-e364-4020-81d0-6a05554f570b","lookup_type":{"ById":"0dedbfa2-e364-4020-81d0-6a05554f570b"},"parent":{"key":"83f572ea-14e0-4788-80cd-26087610a840","lookup_type":{"ById":"83f572ea-14e0-4788-80cd-26087610a840"},"parent":{"key":"6ac9285f-aca7-426a-86f8-a677f8a85ac2","lookup_type":{"ById":"6ac9285f-aca7-426a-86f8-a677f8a85ac2"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"4270b652-82fe-4ee5-bce7-633320104538"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"83f572ea-14e0-4788-80cd-26087610a840","ram_diff":1073741824},"destroy_active_vmm":"b3d5b221-76e9-4917-b9db-ebd62a013ad0","destroy_target_vmm":null,"network_config":"Delete","new_intent":null,"new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-06-04T04:48:27.679053097Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
33442025-06-04T04:48:27.681ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update
33452025-06-04T04:48:27.685ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update
33462025-06-04T04:48:27.685ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
33472025-06-04T04:48:27.685ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
33482025-06-04T04:48:27.685ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
33492025-06-04T04:48:27.688ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
33502025-06-04T04:48:27.688ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
33512025-06-04T04:48:27.691ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
33522025-06-04T04:48:27.691ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
33532025-06-04T04:48:27.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = fddfa500-c502-47ce-b67d-9ba6d6a724ae roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
33542025-06-04T04:48:27.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = fddfa500-c502-47ce-b67d-9ba6d6a724ae resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
33552025-06-04T04:48:27.694ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
33562025-06-04T04:48:27.694ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("cf5bc504-09ec-40e7-a373-5b676a438ad5")) node_id = 0 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
33572025-06-04T04:48:27.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1326 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = fddfa500-c502-47ce-b67d-9ba6d6a724ae response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
33582025-06-04T04:48:27.698ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
33592025-06-04T04:48:27.698ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
33602025-06-04T04:48:27.703ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 0dedbfa2-e364-4020-81d0-6a05554f570b parent_lock = UpdaterLock { updater_id: 4270b652-82fe-4ee5-bce7-633320104538, locked_gen: Generation(Generation(2)) } saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update
33612025-06-04T04:48:27.703ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = BecomeUpdater
33622025-06-04T04:48:27.703ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = BecomeUpdater
33632025-06-04T04:48:27.711ZDEBGnexus (SagaExecutor): inherited lock from 4270b652-82fe-4ee5-bce7-633320104538 to cf5bc504-09ec-40e7-a373-5b676a438ad5 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 0dedbfa2-e364-4020-81d0-6a05554f570b locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 4270b652-82fe-4ee5-bce7-633320104538 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = BecomeUpdater updater_id = cf5bc504-09ec-40e7-a373-5b676a438ad5
33642025-06-04T04:48:27.711ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:987 instance_id = 0dedbfa2-e364-4020-81d0-6a05554f570b saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update
33652025-06-04T04:48:27.711ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
33662025-06-04T04:48:27.711ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("cf5bc504-09ec-40e7-a373-5b676a438ad5")}) node_id = 1 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
33672025-06-04T04:48:27.714ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
33682025-06-04T04:48:27.714ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
33692025-06-04T04:48:27.717ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
33702025-06-04T04:48:27.717ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
33712025-06-04T04:48:27.720ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
33722025-06-04T04:48:27.720ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
33732025-06-04T04:48:27.723ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1040 instance_id = 0dedbfa2-e364-4020-81d0-6a05554f570b saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update
33742025-06-04T04:48:27.726ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 0dedbfa2-e364-4020-81d0-6a05554f570b
33752025-06-04T04:48:27.728ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = UpdateNetworkConfig
33762025-06-04T04:48:27.728ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = UpdateNetworkConfig
33772025-06-04T04:48:27.733ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = UpdateNetworkConfig
33782025-06-04T04:48:27.733ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = UpdateNetworkConfig
33792025-06-04T04:48:27.735ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
33802025-06-04T04:48:27.735ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = UpdateNetworkConfig
33812025-06-04T04:48:27.735ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = UpdateNetworkConfig
33822025-06-04T04:48:27.737ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
33832025-06-04T04:48:27.737ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
33842025-06-04T04:48:27.737ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
33852025-06-04T04:48:27.739ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
33862025-06-04T04:48:27.740ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
33872025-06-04T04:48:27.740ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
33882025-06-04T04:48:27.740ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
33892025-06-04T04:48:27.747ZDEBGnexus: notifying dendrite of updates instance_id = Some(0dedbfa2-e364-4020-81d0-6a05554f570b (instance)) switch = switch0
33902025-06-04T04:48:27.747ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1531, tv_nsec: 912415149 } })
33912025-06-04T04:48:27.750ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1179
33922025-06-04T04:48:27.779ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
33932025-06-04T04:48:27.779ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33942025-06-04T04:48:27.780ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c31fc292-252d-411b-a5cc-4a9394f68784", "content-length": "26", "date": "Wed, 04 Jun 2025 04:48:27 GMT"} })
33952025-06-04T04:48:27.780ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33962025-06-04T04:48:27.780ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
33972025-06-04T04:48:27.810ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
33982025-06-04T04:48:27.810ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
33992025-06-04T04:48:27.818ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
34002025-06-04T04:48:27.818ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
34012025-06-04T04:48:27.824ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = ReleaseVirtualProvisioning
34022025-06-04T04:48:27.824ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = ReleaseVirtualProvisioning
34032025-06-04T04:48:27.841ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1115 instance_id = 0dedbfa2-e364-4020-81d0-6a05554f570b records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-06-04T04:48:27.825754Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 6ac9285f-aca7-426a-86f8-a677f8a85ac2, time_modified: Some(2025-06-04T04:48:27.825754Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 83f572ea-14e0-4788-80cd-26087610a840, time_modified: Some(2025-06-04T04:48:27.825754Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update
34042025-06-04T04:48:27.841ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
34052025-06-04T04:48:27.841ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
34062025-06-04T04:48:27.844ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
34072025-06-04T04:48:27.844ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
34082025-06-04T04:48:27.850ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1150 instance_id = 0dedbfa2-e364-4020-81d0-6a05554f570b saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update
34092025-06-04T04:48:27.850ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = UnassignOximeterProducer
34102025-06-04T04:48:27.850ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = UnassignOximeterProducer
34112025-06-04T04:48:27.857ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 6e958f0b-8d3a-47ee-bfea-40bd8f174cf7 producer_id = 0dedbfa2-e364-4020-81d0-6a05554f570b saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update
34122025-06-04T04:48:27.857ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = UnassignOximeterProducer
34132025-06-04T04:48:27.857ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = UnassignOximeterProducer
34142025-06-04T04:48:27.892ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 0dedbfa2-e364-4020-81d0-6a05554f570b saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update
34152025-06-04T04:48:27.893ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 0dedbfa2-e364-4020-81d0-6a05554f570b saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/0dedbfa2-e364-4020-81d0-6a05554f570b
34162025-06-04T04:48:27.920ZDEBGnexus (SagaExecutor): client response oximeter-collector = 0dedbfa2-e364-4020-81d0-6a05554f570b result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/0dedbfa2-e364-4020-81d0-6a05554f570b", status: 204, headers: {"x-request-id": "bac1f6b6-acc9-4087-9a0a-e80836b7a941", "date": "Wed, 04 Jun 2025 04:48:27 GMT"} }) saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update
34172025-06-04T04:48:27.920ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 6e958f0b-8d3a-47ee-bfea-40bd8f174cf7 producer_id = 0dedbfa2-e364-4020-81d0-6a05554f570b saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update
34182025-06-04T04:48:27.921ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
34192025-06-04T04:48:27.921ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
34202025-06-04T04:48:27.924ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
34212025-06-04T04:48:27.924ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
34222025-06-04T04:48:27.927ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 0dedbfa2-e364-4020-81d0-6a05554f570b lock = UpdaterLock { updater_id: cf5bc504-09ec-40e7-a373-5b676a438ad5, locked_gen: Generation(Generation(3)) } new_intent = None new_runtime = InstanceRuntimeState { time_updated: 2025-06-04T04:48:27.679053097Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update
34232025-06-04T04:48:27.927ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = CommitInstanceUpdates
34242025-06-04T04:48:27.927ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = CommitInstanceUpdates
34252025-06-04T04:48:27.973ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1201 instance_id = 0dedbfa2-e364-4020-81d0-6a05554f570b new_runtime = InstanceRuntimeState { time_updated: 2025-06-04T04:48:27.679053097Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update
34262025-06-04T04:48:27.973ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
34272025-06-04T04:48:27.973ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
34282025-06-04T04:48:27.973ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Signaled
34292025-06-04T04:48:27.973ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Signaled
34302025-06-04T04:48:27.973ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
34312025-06-04T04:48:27.973ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34322025-06-04T04:48:27.973ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34332025-06-04T04:48:27.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34342025-06-04T04:48:27.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34352025-06-04T04:48:27.975ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34362025-06-04T04:48:27.976ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34372025-06-04T04:48:27.976ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34382025-06-04T04:48:27.976ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
34392025-06-04T04:48:27.976ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
34402025-06-04T04:48:27.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34412025-06-04T04:48:27.978ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34422025-06-04T04:48:27.980ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
34432025-06-04T04:48:27.980ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("0dedbfa2-e364-4020-81d0-6a05554f570b"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("b3d5b221-76e9-4917-b9db-ebd62a013ad0")}) node_id = 7 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
34442025-06-04T04:48:27.980ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34452025-06-04T04:48:27.980ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34462025-06-04T04:48:27.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34472025-06-04T04:48:27.983ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
34482025-06-04T04:48:27.983ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
34492025-06-04T04:48:27.987ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
34502025-06-04T04:48:27.987ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
34512025-06-04T04:48:27.990ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
34522025-06-04T04:48:27.990ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
34532025-06-04T04:48:27.993ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:82 instance_id = 0dedbfa2-e364-4020-81d0-6a05554f570b propolis_id = b3d5b221-76e9-4917-b9db-ebd62a013ad0 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update
34542025-06-04T04:48:27.999ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = ReleaseSledResources
34552025-06-04T04:48:27.999ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = ReleaseSledResources
34562025-06-04T04:48:28.003ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
34572025-06-04T04:48:28.003ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
34582025-06-04T04:48:28.006ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
34592025-06-04T04:48:28.006ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
34602025-06-04T04:48:28.009ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:113 instance_id = 0dedbfa2-e364-4020-81d0-6a05554f570b propolis_id = b3d5b221-76e9-4917-b9db-ebd62a013ad0 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update
34612025-06-04T04:48:28.009ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = MarkVmmDeleted
34622025-06-04T04:48:28.010ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = MarkVmmDeleted
34632025-06-04T04:48:28.020ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
34642025-06-04T04:48:28.020ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
34652025-06-04T04:48:28.024ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
34662025-06-04T04:48:28.024ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
34672025-06-04T04:48:28.028ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
34682025-06-04T04:48:28.028ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
34692025-06-04T04:48:28.031ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
34702025-06-04T04:48:28.031ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
34712025-06-04T04:48:28.034ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = ChainSuccessorSaga
34722025-06-04T04:48:28.034ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = ChainSuccessorSaga
34732025-06-04T04:48:28.035ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = ChainSuccessorSaga
34742025-06-04T04:48:28.036ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = ChainSuccessorSaga
34752025-06-04T04:48:28.037ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = ChainSuccessorSaga
34762025-06-04T04:48:28.037ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = ChainSuccessorSaga
34772025-06-04T04:48:28.038ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = ChainSuccessorSaga
34782025-06-04T04:48:28.041ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 6ac9285f-aca7-426a-86f8-a677f8a85ac2, lookup_type: ById(6ac9285f-aca7-426a-86f8-a677f8a85ac2) }, key: 83f572ea-14e0-4788-80cd-26087610a840, lookup_type: ById(83f572ea-14e0-4788-80cd-26087610a840) }, key: 0dedbfa2-e364-4020-81d0-6a05554f570b, lookup_type: ById(0dedbfa2-e364-4020-81d0-6a05554f570b) } result = Ok(()) saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = ChainSuccessorSaga
34792025-06-04T04:48:28.041ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = ChainSuccessorSaga
34802025-06-04T04:48:28.041ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_node = ChainSuccessorSaga
34812025-06-04T04:48:28.052ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34822025-06-04T04:48:28.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34832025-06-04T04:48:28.055ZWARNnexus (SagaExecutor): instance update: failed to start successor saga! error = failed to fetch latest snapshot for instance file = nexus/src/app/sagas/instance_update/mod.rs:1351 instance_id = 0dedbfa2-e364-4020-81d0-6a05554f570b saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update
34842025-06-04T04:48:28.055ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
34852025-06-04T04:48:28.055ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
34862025-06-04T04:48:28.055ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Signaled
34872025-06-04T04:48:28.055ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
34882025-06-04T04:48:28.055ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34892025-06-04T04:48:28.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34902025-06-04T04:48:28.058ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
34912025-06-04T04:48:28.058ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
34922025-06-04T04:48:28.060ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34932025-06-04T04:48:28.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34942025-06-04T04:48:28.061ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
34952025-06-04T04:48:28.061ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
34962025-06-04T04:48:28.076ZINFOnexus (BackgroundTasks): VPC route manager sled cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
34972025-06-04T04:48:28.076ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34982025-06-04T04:48:28.076ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b796d5af-d2e5-4d08-bb39-fde9ab4fb486", "content-length": "372", "date": "Wed, 04 Jun 2025 04:48:28 GMT"} })
34992025-06-04T04:48:28.076ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35002025-06-04T04:48:28.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35012025-06-04T04:48:28.080ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
35022025-06-04T04:48:28.080ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b
35032025-06-04T04:48:28.087ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35042025-06-04T04:48:28.088ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
35052025-06-04T04:48:28.088ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35062025-06-04T04:48:28.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35072025-06-04T04:48:28.093ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35082025-06-04T04:48:28.093ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
35092025-06-04T04:48:28.093ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35102025-06-04T04:48:28.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35112025-06-04T04:48:28.096ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
35122025-06-04T04:48:28.096ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
35132025-06-04T04:48:28.096ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "999bd00a-8595-45f3-81d4-ec22641c66db", "date": "Wed, 04 Jun 2025 04:48:28 GMT"} })
35142025-06-04T04:48:28.096ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35152025-06-04T04:48:28.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35162025-06-04T04:48:28.098ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35172025-06-04T04:48:28.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35182025-06-04T04:48:28.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35192025-06-04T04:48:28.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35202025-06-04T04:48:28.104ZINFOnexus (BackgroundTasks): VPC route manager sled cb8aa4e2-773a-4f3e-86b7-f32104e9c4de push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
35212025-06-04T04:48:28.104ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35222025-06-04T04:48:28.105ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "089473d1-06e3-4700-a5c8-5b41c12b3b11", "date": "Wed, 04 Jun 2025 04:48:28 GMT"} })
35232025-06-04T04:48:28.106ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 133.088109ms iteration = 25 status = {}
35242025-06-04T04:48:28.116ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35252025-06-04T04:48:28.117ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35262025-06-04T04:48:28.117ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35272025-06-04T04:48:28.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35282025-06-04T04:48:28.119ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35292025-06-04T04:48:28.120ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35302025-06-04T04:48:28.120ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35312025-06-04T04:48:28.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35322025-06-04T04:48:28.130ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35332025-06-04T04:48:28.130ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
35342025-06-04T04:48:28.130ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 75.825321ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
35352025-06-04T04:48:28.132ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
35362025-06-04T04:48:28.134ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b saga_name = instance-update saga_result = SagaResult { saga_id: fafee2dd-6eb4-4acf-a2b4-4d764e27531b, saga_log: SagaLog { saga_id: fafee2dd-6eb4-4acf-a2b4-4d764e27531b, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("cf5bc504-09ec-40e7-a373-5b676a438ad5")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("cf5bc504-09ec-40e7-a373-5b676a438ad5")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("0dedbfa2-e364-4020-81d0-6a05554f570b"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("b3d5b221-76e9-4917-b9db-ebd62a013ad0")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("0dedbfa2-e364-4020-81d0-6a05554f570b"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("b3d5b221-76e9-4917-b9db-ebd62a013ad0")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("cf5bc504-09ec-40e7-a373-5b676a438ad5"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("cf5bc504-09ec-40e7-a373-5b676a438ad5")}} }) }
35372025-06-04T04:48:28.134ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = fafee2dd-6eb4-4acf-a2b4-4d764e27531b instance_id = 0dedbfa2-e364-4020-81d0-6a05554f570b saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update
35382025-06-04T04:48:28.134ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
35392025-06-04T04:48:28.134ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15
35402025-06-04T04:48:28.138ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
35412025-06-04T04:48:28.138ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15
35422025-06-04T04:48:28.141ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
35432025-06-04T04:48:28.141ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15
35442025-06-04T04:48:28.144ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
35452025-06-04T04:48:28.144ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15
35462025-06-04T04:48:28.183ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update sec_id = 88f0624a-d154-4dd4-8e91-901bdcc509e0
35472025-06-04T04:48:28.184ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 0eeb7d90-2dec-4d78-a5f4-9394eb69df15 saga_name = start-instance-update saga_result = SagaResult { saga_id: 0eeb7d90-2dec-4d78-a5f4-9394eb69df15, saga_log: SagaLog { saga_id: 0eeb7d90-2dec-4d78-a5f4-9394eb69df15, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("4270b652-82fe-4ee5-bce7-633320104538")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("4270b652-82fe-4ee5-bce7-633320104538")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("4270b652-82fe-4ee5-bce7-633320104538"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("4270b652-82fe-4ee5-bce7-633320104538")}} }) }
35482025-06-04T04:48:28.219ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
35492025-06-04T04:48:28.219ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7cc5a80a-a31e-441f-b690-a787c4dd83fa", "content-length": "691", "date": "Wed, 04 Jun 2025 04:48:28 GMT"} })
35502025-06-04T04:48:28.219ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
35512025-06-04T04:48:28.219ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
35522025-06-04T04:48:28.219ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
35532025-06-04T04:48:28.220ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 246.842576ms iteration = 25 status = {}
35542025-06-04T04:48:28.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = fb163aae-4a06-49f4-ba98-aaf87162f069 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
35552025-06-04T04:48:28.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = fb163aae-4a06-49f4-ba98-aaf87162f069 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
35562025-06-04T04:48:28.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1822 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = fb163aae-4a06-49f4-ba98-aaf87162f069 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
35572025-06-04T04:48:29.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 356c6fca-55b4-474f-b551-4d86ff4a0913 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
35582025-06-04T04:48:29.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 356c6fca-55b4-474f-b551-4d86ff4a0913 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
35592025-06-04T04:48:29.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1876 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 356c6fca-55b4-474f-b551-4d86ff4a0913 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
35602025-06-04T04:48:30.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 470d08b5-4fed-4ecd-841c-1a2f2e4cd42f roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
35612025-06-04T04:48:30.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 470d08b5-4fed-4ecd-841c-1a2f2e4cd42f resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
35622025-06-04T04:48:30.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 6300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 470d08b5-4fed-4ecd-841c-1a2f2e4cd42f response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
35632025-06-04T04:48:30.894ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
35642025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
35652025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35662025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35672025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
35682025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
35692025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
35702025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35712025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
35722025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
35732025-06-04T04:48:30.895ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-06-04 04:38:30.895043898 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
35742025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
35752025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
35762025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
35772025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
35782025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35792025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
35802025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
35812025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
35822025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
35832025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
35842025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
35852025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35862025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35872025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
35882025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
35892025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35902025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 25 reason = Timeout
35912025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
35922025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
35932025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35942025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
35952025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
35962025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35972025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
35982025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
35992025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36002025-06-04T04:48:30.895ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c
36012025-06-04T04:48:30.895ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
36022025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36032025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
36042025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c"}
36052025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
36062025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
36072025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
36082025-06-04T04:48:30.895ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
36092025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
36102025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36112025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
36122025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36132025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36142025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
36152025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36162025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36172025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
36182025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36192025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
36202025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36212025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36222025-06-04T04:48:30.895ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6bd72d79-86a4-4394-904a-eda88bc21fd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("badd8271-e80d-44a0-993c-76a669a9eadb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f664b51a-ef20-45b7-9cac-a2aa17e449b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f664b51a-ef20-45b7-9cac-a2aa17e449b7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1535, tv_nsec: 60525121 } })
36232025-06-04T04:48:30.895ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3147fdc0-57b9-465b-97b1-724db3a98549.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fd2bb11e-a66c-4a76-9d9e-ddc3f90ca952.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fd2bb11e-a66c-4a76-9d9e-ddc3f90ca952.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1535, tv_nsec: 60546521 } })
36242025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
36252025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
36262025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36272025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36282025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36292025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36302025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
36312025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36322025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36332025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36342025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36352025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
36362025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36372025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36382025-06-04T04:48:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36392025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36402025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36412025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36422025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36432025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
36442025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36452025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.170637ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
36462025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
36472025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36482025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
36492025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
36502025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
36512025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
36522025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
36532025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
36542025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
36552025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36562025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 25 reason = Timeout
36572025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
36582025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 13 reason = Timeout
36592025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
36602025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
36612025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
36622025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 13 reason = Timeout
36632025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
36642025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
36652025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36662025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36672025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.460602ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
36682025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36692025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
36702025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
36712025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
36722025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
36732025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
36742025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36752025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
36762025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
36772025-06-04T04:48:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36782025-06-04T04:48:30.897ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36792025-06-04T04:48:30.898ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36802025-06-04T04:48:30.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36812025-06-04T04:48:30.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36822025-06-04T04:48:30.899ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
36832025-06-04T04:48:30.899ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36842025-06-04T04:48:30.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36852025-06-04T04:48:30.899ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1535, tv_nsec: 64136516 } })
36862025-06-04T04:48:30.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36872025-06-04T04:48:30.899ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-06-04 04:38:30.895043898 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
36882025-06-04T04:48:30.899ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.401907ms iteration = 13 status = {"expiration":"2025-06-04T04:38:30.895043898Z","pruned":[]}
36892025-06-04T04:48:30.899ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
36902025-06-04T04:48:30.899ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.454437ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
36912025-06-04T04:48:30.901ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36922025-06-04T04:48:30.901ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1535, tv_nsec: 66749195 } })
36932025-06-04T04:48:30.902ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
36942025-06-04T04:48:30.902ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36952025-06-04T04:48:30.902ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36962025-06-04T04:48:30.902ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36972025-06-04T04:48:30.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
36982025-06-04T04:48:30.904ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36992025-06-04T04:48:30.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
37002025-06-04T04:48:30.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
37012025-06-04T04:48:30.905ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
37022025-06-04T04:48:30.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
37032025-06-04T04:48:30.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37042025-06-04T04:48:30.906ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37052025-06-04T04:48:30.906ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37062025-06-04T04:48:30.906ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37072025-06-04T04:48:30.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37082025-06-04T04:48:30.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37092025-06-04T04:48:30.907ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37102025-06-04T04:48:30.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
37112025-06-04T04:48:30.908ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37122025-06-04T04:48:30.909ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37132025-06-04T04:48:30.910ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37142025-06-04T04:48:30.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
37152025-06-04T04:48:30.911ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37162025-06-04T04:48:30.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37172025-06-04T04:48:30.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
37182025-06-04T04:48:30.913ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37192025-06-04T04:48:30.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
37202025-06-04T04:48:30.913ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
37212025-06-04T04:48:30.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37222025-06-04T04:48:30.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
37232025-06-04T04:48:30.914ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37242025-06-04T04:48:30.917ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
37252025-06-04T04:48:30.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
37262025-06-04T04:48:30.917ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
37272025-06-04T04:48:30.917ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
37282025-06-04T04:48:30.917ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 20.952518ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
37292025-06-04T04:48:30.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
37302025-06-04T04:48:30.917ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37312025-06-04T04:48:30.918ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
37322025-06-04T04:48:30.918ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 21.921293ms iteration = 13 status = {"by_rx":{},"error":null}
37332025-06-04T04:48:30.918ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 22.073335ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
37342025-06-04T04:48:30.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
37352025-06-04T04:48:30.919ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
37362025-06-04T04:48:30.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
37372025-06-04T04:48:30.922ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37382025-06-04T04:48:30.926ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37392025-06-04T04:48:30.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
37402025-06-04T04:48:30.927ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
37412025-06-04T04:48:30.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
37422025-06-04T04:48:30.930ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
37432025-06-04T04:48:30.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
37442025-06-04T04:48:30.931ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
37452025-06-04T04:48:30.931ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 35.390387ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
37462025-06-04T04:48:30.935ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37472025-06-04T04:48:30.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37482025-06-04T04:48:30.939ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1535, tv_nsec: 104234344 } })
37492025-06-04T04:48:30.939ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36
37502025-06-04T04:48:30.961ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37512025-06-04T04:48:30.962ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37522025-06-04T04:48:30.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
37532025-06-04T04:48:30.964ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
37542025-06-04T04:48:30.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
37552025-06-04T04:48:30.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37562025-06-04T04:48:30.965ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37572025-06-04T04:48:30.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37582025-06-04T04:48:30.967ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37592025-06-04T04:48:30.968ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37602025-06-04T04:48:30.968ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37612025-06-04T04:48:30.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37622025-06-04T04:48:30.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37632025-06-04T04:48:30.969ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37642025-06-04T04:48:30.969ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37652025-06-04T04:48:30.969ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37662025-06-04T04:48:30.969ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
37672025-06-04T04:48:30.969ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37682025-06-04T04:48:30.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37692025-06-04T04:48:30.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37702025-06-04T04:48:30.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37712025-06-04T04:48:30.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
37722025-06-04T04:48:30.971ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37732025-06-04T04:48:30.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37742025-06-04T04:48:30.973ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37752025-06-04T04:48:30.975ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37762025-06-04T04:48:30.976ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1dd88a28-32c4-4490-89f2-ae05402d904c, lookup_type: ById(1dd88a28-32c4-4490-89f2-ae05402d904c) } result = Ok(())
37772025-06-04T04:48:30.976ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37782025-06-04T04:48:30.976ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
37792025-06-04T04:48:30.976ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
37802025-06-04T04:48:30.976ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
37812025-06-04T04:48:30.976ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
37822025-06-04T04:48:30.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37832025-06-04T04:48:30.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
37842025-06-04T04:48:30.976ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
37852025-06-04T04:48:30.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
37862025-06-04T04:48:30.978ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37872025-06-04T04:48:30.978ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 82.497892ms iteration = 25 status = {"errors":[],"requests_created_ok":[]}
37882025-06-04T04:48:30.979ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
37892025-06-04T04:48:30.979ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
37902025-06-04T04:48:30.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
37912025-06-04T04:48:30.980ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37922025-06-04T04:48:30.980ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37932025-06-04T04:48:30.980ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 84.428032ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
37942025-06-04T04:48:30.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37952025-06-04T04:48:30.981ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 85.923064ms iteration = 6 status = {"nsuccess":5}
37962025-06-04T04:48:30.982ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37972025-06-04T04:48:30.983ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37982025-06-04T04:48:30.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37992025-06-04T04:48:30.986ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
38002025-06-04T04:48:30.986ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38012025-06-04T04:48:30.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38022025-06-04T04:48:30.987ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38032025-06-04T04:48:30.987ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
38042025-06-04T04:48:30.987ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38052025-06-04T04:48:30.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38062025-06-04T04:48:30.989ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
38072025-06-04T04:48:30.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
38082025-06-04T04:48:30.990ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38092025-06-04T04:48:30.992ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38102025-06-04T04:48:30.992ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 96.1776ms iteration = 13 status = {"dispatched":[],"errors":[],"glob_version":"146.0.0","globs_reprocessed":{},"no_receivers":[]}
38112025-06-04T04:48:30.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
38122025-06-04T04:48:30.995ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
38132025-06-04T04:48:30.995ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38142025-06-04T04:48:30.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38152025-06-04T04:48:30.996ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38162025-06-04T04:48:30.996ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38172025-06-04T04:48:30.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38182025-06-04T04:48:30.998ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
38192025-06-04T04:48:30.998ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38202025-06-04T04:48:30.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38212025-06-04T04:48:31.001ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 106.234833ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
38222025-06-04T04:48:31.002ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38232025-06-04T04:48:31.003ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
38242025-06-04T04:48:31.003ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
38252025-06-04T04:48:31.003ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 107.685875ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
38262025-06-04T04:48:31.004ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
38272025-06-04T04:48:31.004ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
38282025-06-04T04:48:31.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
38292025-06-04T04:48:31.005ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38302025-06-04T04:48:31.008ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38312025-06-04T04:48:31.008ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38322025-06-04T04:48:31.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38332025-06-04T04:48:31.010ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
38342025-06-04T04:48:31.010ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 114.953815ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
38352025-06-04T04:48:31.011ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38362025-06-04T04:48:31.011ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c original_time_created = 2025-06-04 04:36:14.609521 UTC target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c time_created = 2025-06-04 04:36:14.609521 UTC
38372025-06-04T04:48:31.011ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 116.707572ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","time_created":"2025-06-04T04:36:14.609521Z"}
38382025-06-04T04:48:31.013ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38392025-06-04T04:48:31.014ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38402025-06-04T04:48:31.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38412025-06-04T04:48:31.042ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
38422025-06-04T04:48:31.042ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
38432025-06-04T04:48:31.042ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
38442025-06-04T04:48:31.042ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38452025-06-04T04:48:31.042ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
38462025-06-04T04:48:31.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38472025-06-04T04:48:31.043ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38482025-06-04T04:48:31.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38492025-06-04T04:48:31.044ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 149.344857ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38502025-06-04T04:48:31.045ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38512025-06-04T04:48:31.045ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
38522025-06-04T04:48:31.045ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 150.436473ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
38532025-06-04T04:48:31.054ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38542025-06-04T04:48:31.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38552025-06-04T04:48:31.059ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
38562025-06-04T04:48:31.059ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 787b83fc-6b83-4eec-b3a2-7c7c59871d86 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
38572025-06-04T04:48:31.059ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38582025-06-04T04:48:31.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38592025-06-04T04:48:31.060ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 164.571958ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
38602025-06-04T04:48:31.061ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
38612025-06-04T04:48:31.061ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38622025-06-04T04:48:31.061ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c46d87d8-d887-415e-a672-79c89bb1a128", "content-length": "26", "date": "Wed, 04 Jun 2025 04:48:31 GMT"} })
38632025-06-04T04:48:31.061ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38642025-06-04T04:48:31.063ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38652025-06-04T04:48:31.063ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 167.034965ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
38662025-06-04T04:48:31.065ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
38672025-06-04T04:48:31.065ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38682025-06-04T04:48:31.066ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1864d67-74a6-42c6-bb64-9108a1d3bbb8", "content-length": "26", "date": "Wed, 04 Jun 2025 04:48:31 GMT"} })
38692025-06-04T04:48:31.066ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38702025-06-04T04:48:31.067ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38712025-06-04T04:48:31.068ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
38722025-06-04T04:48:31.068ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 173.194119ms iteration = 25 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
38732025-06-04T04:48:31.076ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
38742025-06-04T04:48:31.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
38752025-06-04T04:48:31.142ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
38762025-06-04T04:48:31.145ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 250.014663ms iteration = 28 status = {"physical_disks_added":0}
38772025-06-04T04:48:31.175ZINFOnexus (BackgroundTasks): VPC route manager sled cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
38782025-06-04T04:48:31.175ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38792025-06-04T04:48:31.175ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "41db3f00-434e-4e94-886f-61b391926cd2", "content-length": "372", "date": "Wed, 04 Jun 2025 04:48:30 GMT"} })
38802025-06-04T04:48:31.175ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38812025-06-04T04:48:31.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38822025-06-04T04:48:31.177ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38832025-06-04T04:48:31.177ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38842025-06-04T04:48:31.178ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38852025-06-04T04:48:31.178ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38862025-06-04T04:48:31.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38872025-06-04T04:48:31.180ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
38882025-06-04T04:48:31.180ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38892025-06-04T04:48:31.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38902025-06-04T04:48:31.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
38912025-06-04T04:48:31.181ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38922025-06-04T04:48:31.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38932025-06-04T04:48:31.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
38942025-06-04T04:48:31.183ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38952025-06-04T04:48:31.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38962025-06-04T04:48:31.200ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 zone_address = fd00:1122:3344:101::2
38972025-06-04T04:48:31.200ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38982025-06-04T04:48:31.201ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8921607e-f570-40e9-a93f-746a0b3b588d", "content-length": "26", "date": "Wed, 04 Jun 2025 04:48:31 GMT"} })
38992025-06-04T04:48:31.201ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39002025-06-04T04:48:31.202ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36
39012025-06-04T04:48:31.224ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
39022025-06-04T04:48:31.224ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e2c5d0dd-d386-44a7-b792-d252a0941ead", "date": "Wed, 04 Jun 2025 04:48:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
39032025-06-04T04:48:31.224ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
39042025-06-04T04:48:31.226ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "1fcbfb05-d4b5-40bd-96ae-121f3bc42ace", "date": "Wed, 04 Jun 2025 04:48:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
39052025-06-04T04:48:31.226ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
39062025-06-04T04:48:31.227ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
39072025-06-04T04:48:31.227ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 332.8496ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
39082025-06-04T04:48:31.240ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 345.34115ms iteration = 25 status = {}
39092025-06-04T04:48:31.244ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39102025-06-04T04:48:31.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39112025-06-04T04:48:31.271ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
39122025-06-04T04:48:31.275ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39132025-06-04T04:48:31.278ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 383.740693ms iteration = 25 status = null
39142025-06-04T04:48:31.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cb8aa4e2-773a-4f3e-86b7-f32104e9c4de, lookup_type: ById(cb8aa4e2-773a-4f3e-86b7-f32104e9c4de) } result = Ok(())
39152025-06-04T04:48:31.279ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39162025-06-04T04:48:31.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39172025-06-04T04:48:31.280ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 787b83fc-6b83-4eec-b3a2-7c7c59871d86 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
39182025-06-04T04:48:31.281ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
39192025-06-04T04:48:31.281ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-06-04 04:36:31.280949 UTC dns_group = internal generation = 1
39202025-06-04T04:48:31.281ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 385.933087ms iteration = 13 status = {"generation":1}
39212025-06-04T04:48:31.281ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 385.907096ms iteration = 25 status = 0
39222025-06-04T04:48:31.287ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
39232025-06-04T04:48:31.312ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-06-04T04:36:26.716717Z, time_modified: 2025-06-04T04:36:26.716717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 6ac9285f-aca7-426a-86f8-a677f8a85ac2, db_silo: Silo { identity: SiloIdentity { id: 6ac9285f-aca7-426a-86f8-a677f8a85ac2, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-04T04:36:32.675073Z, time_modified: 2025-06-04T04:36:32.675073Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "26b91f4e65966da67879de126c5f5f1398a4ef21b95a2113db132d6cfa56d902" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 6ac9285f-aca7-426a-86f8-a677f8a85ac2, db_silo: Silo { identity: SiloIdentity { id: 6ac9285f-aca7-426a-86f8-a677f8a85ac2, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-04T04:36:32.675073Z, time_modified: 2025-06-04T04:36:32.675073Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "26b91f4e65966da67879de126c5f5f1398a4ef21b95a2113db132d6cfa56d902" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
39242025-06-04T04:48:31.312ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 417.13841ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"6ac9285f-aca7-426a-86f8-a677f8a85ac2","tls_certs":["26b91f4e65966da67879de126c5f5f1398a4ef21b95a2113db132d6cfa56d902"]}},"default_endpoint":{"silo_id":"6ac9285f-aca7-426a-86f8-a677f8a85ac2","tls_certs":["26b91f4e65966da67879de126c5f5f1398a4ef21b95a2113db132d6cfa56d902"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
39252025-06-04T04:48:31.313ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
39262025-06-04T04:48:31.313ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ce77201a-6012-44b3-bdd1-aa82b5d93c9b dns_zone_name = oxide.test found_so_far = 0 version = 2
39272025-06-04T04:48:31.313ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39282025-06-04T04:48:31.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39292025-06-04T04:48:31.315ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39302025-06-04T04:48:31.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
39312025-06-04T04:48:31.318ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39322025-06-04T04:48:31.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39332025-06-04T04:48:31.320ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ce77201a-6012-44b3-bdd1-aa82b5d93c9b dns_zone_name = oxide.test found_so_far = 4 version = 2
39342025-06-04T04:48:31.320ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
39352025-06-04T04:48:31.320ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-06-04 04:36:32.761780 UTC dns_group = external generation = 2
39362025-06-04T04:48:31.320ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 425.231283ms iteration = 13 status = {"generation":2}
39372025-06-04T04:48:31.323ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
39382025-06-04T04:48:31.323ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
39392025-06-04T04:48:31.349ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
39402025-06-04T04:48:31.350ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "c1d03a8a-a32b-4e03-86d8-3a67464e20bf", "date": "Wed, 04 Jun 2025 04:48:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
39412025-06-04T04:48:31.350ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
39422025-06-04T04:48:31.351ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "7b5068be-731c-41f5-b692-2341a924b4f6", "date": "Wed, 04 Jun 2025 04:48:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
39432025-06-04T04:48:31.351ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
39442025-06-04T04:48:31.353ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "fd51745a-90ad-4fcd-b7a4-7f340c8d4a0f", "date": "Wed, 04 Jun 2025 04:48:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
39452025-06-04T04:48:31.353ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
39462025-06-04T04:48:31.355ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
39472025-06-04T04:48:31.355ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 460.133954ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
39482025-06-04T04:48:31.376ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f55d7102-4012-41b0-87f8-3792c5053cd9", "date": "Wed, 04 Jun 2025 04:48:31 GMT"} })
39492025-06-04T04:48:31.376ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39502025-06-04T04:48:31.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39512025-06-04T04:48:31.376ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "71a6d6b5-6cf0-42b2-ac19-b997ef507f31", "content-length": "691", "date": "Wed, 04 Jun 2025 04:48:30 GMT"} })
39522025-06-04T04:48:31.376ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
39532025-06-04T04:48:31.376ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
39542025-06-04T04:48:31.376ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
39552025-06-04T04:48:31.378ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 482.723396ms iteration = 26 status = {}
39562025-06-04T04:48:31.379ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39572025-06-04T04:48:31.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39582025-06-04T04:48:31.380ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
39592025-06-04T04:48:31.380ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 485.319345ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
39602025-06-04T04:48:31.383ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39612025-06-04T04:48:31.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39622025-06-04T04:48:31.384ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39632025-06-04T04:48:31.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39642025-06-04T04:48:31.386ZINFOnexus (BackgroundTasks): VPC route manager sled cb8aa4e2-773a-4f3e-86b7-f32104e9c4de push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
39652025-06-04T04:48:31.386ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
39662025-06-04T04:48:31.386ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "500ec72f-75fd-4289-b6d5-cb2365bc4381", "date": "Wed, 04 Jun 2025 04:48:31 GMT"} })
39672025-06-04T04:48:31.387ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: a0769b7e-afb1-46f8-b225-eac4dddfaf8d, rack_id: 5a147cfa-15ac-4bf0-8777-c82b354c8c36, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(913c54af-e122-4277-b509-f8a495f24eae) } rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch_location = Switch0
39682025-06-04T04:48:31.387ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39692025-06-04T04:48:31.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39702025-06-04T04:48:31.388ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 493.106753ms iteration = 26 status = {}
39712025-06-04T04:48:31.400ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
39722025-06-04T04:48:31.400ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 913c54af-e122-4277-b509-f8a495f24eae
39732025-06-04T04:48:31.400ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
39742025-06-04T04:48:31.401ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
39752025-06-04T04:48:31.401ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39762025-06-04T04:48:31.401ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39772025-06-04T04:48:31.401ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39782025-06-04T04:48:31.401ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
39792025-06-04T04:48:31.401ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39802025-06-04T04:48:31.401ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
39812025-06-04T04:48:31.401ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36
39822025-06-04T04:48:31.401ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39832025-06-04T04:48:31.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39842025-06-04T04:48:31.403ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch_location = Switch0
39852025-06-04T04:48:31.403ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
39862025-06-04T04:48:31.601ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6321b986-7e84-4f54-baae-43fc6f0329ee", "date": "Wed, 04 Jun 2025 04:48:30 GMT"} })
39872025-06-04T04:48:31.601ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch = Switch0
39882025-06-04T04:48:31.601ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
39892025-06-04T04:48:31.601ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a8a18b2-d1a4-49e9-89a7-670870286222", "content-length": "682", "date": "Wed, 04 Jun 2025 04:48:31 GMT"} })
39902025-06-04T04:48:31.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39912025-06-04T04:48:31.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39922025-06-04T04:48:31.607ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39932025-06-04T04:48:31.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39942025-06-04T04:48:31.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39952025-06-04T04:48:31.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39962025-06-04T04:48:31.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39972025-06-04T04:48:31.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39982025-06-04T04:48:31.624ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 728.699759ms iteration = 25 status = {}
39992025-06-04T04:48:31.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = af890b9e-f511-40d2-ba8b-6097cc7a2da6 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40002025-06-04T04:48:31.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = af890b9e-f511-40d2-ba8b-6097cc7a2da6 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40012025-06-04T04:48:31.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2515 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = af890b9e-f511-40d2-ba8b-6097cc7a2da6 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40022025-06-04T04:48:32.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 8d6d105a-5ff8-48c9-bbc3-f080f21ff722 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40032025-06-04T04:48:32.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 8d6d105a-5ff8-48c9-bbc3-f080f21ff722 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40042025-06-04T04:48:32.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2176 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 8d6d105a-5ff8-48c9-bbc3-f080f21ff722 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40052025-06-04T04:48:33.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 7f20c042-64ff-4237-9375-ec1a53d98645 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40062025-06-04T04:48:33.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 7f20c042-64ff-4237-9375-ec1a53d98645 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40072025-06-04T04:48:33.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2654 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 7f20c042-64ff-4237-9375-ec1a53d98645 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40082025-06-04T04:48:34.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c7b0f257-5ef7-403d-b898-13170f0f1486 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40092025-06-04T04:48:34.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c7b0f257-5ef7-403d-b898-13170f0f1486 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40102025-06-04T04:48:34.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c7b0f257-5ef7-403d-b898-13170f0f1486 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40112025-06-04T04:48:35.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 40d649fd-6310-4159-b811-3625bcf1376a roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40122025-06-04T04:48:35.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 40d649fd-6310-4159-b811-3625bcf1376a resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40132025-06-04T04:48:35.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2958 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 40d649fd-6310-4159-b811-3625bcf1376a response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40142025-06-04T04:48:36.506ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 958 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = 6fa0ddee-d428-42ea-bfe4-96251fb1c6c7 response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
40152025-06-04T04:48:36.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3bffd321-365b-41c0-a223-fb15f0454c02 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40162025-06-04T04:48:36.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3bffd321-365b-41c0-a223-fb15f0454c02 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40172025-06-04T04:48:36.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2391 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3bffd321-365b-41c0-a223-fb15f0454c02 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40182025-06-04T04:48:37.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = a69683ea-6b63-44b5-bbb2-158ecef42fcb roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40192025-06-04T04:48:37.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = a69683ea-6b63-44b5-bbb2-158ecef42fcb resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40202025-06-04T04:48:37.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1904 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = a69683ea-6b63-44b5-bbb2-158ecef42fcb response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40212025-06-04T04:48:38.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c56fae5d-b41d-4f23-9197-782855ba1f3e roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40222025-06-04T04:48:38.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c56fae5d-b41d-4f23-9197-782855ba1f3e resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40232025-06-04T04:48:38.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c56fae5d-b41d-4f23-9197-782855ba1f3e response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40242025-06-04T04:48:39.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 4ef15363-f17c-433d-a312-b8d430abd7bd roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40252025-06-04T04:48:39.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 4ef15363-f17c-433d-a312-b8d430abd7bd resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40262025-06-04T04:48:39.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2576 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 4ef15363-f17c-433d-a312-b8d430abd7bd response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40272025-06-04T04:48:40.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
40282025-06-04T04:48:40.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
40292025-06-04T04:48:40.896ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40302025-06-04T04:48:40.896ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40312025-06-04T04:48:40.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40322025-06-04T04:48:40.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40332025-06-04T04:48:40.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40342025-06-04T04:48:40.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40352025-06-04T04:48:40.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40362025-06-04T04:48:40.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40372025-06-04T04:48:40.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40382025-06-04T04:48:40.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40392025-06-04T04:48:40.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40402025-06-04T04:48:40.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1dd88a28-32c4-4490-89f2-ae05402d904c, lookup_type: ById(1dd88a28-32c4-4490-89f2-ae05402d904c) } result = Ok(())
40412025-06-04T04:48:40.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40422025-06-04T04:48:40.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40432025-06-04T04:48:40.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5339fd7a-542c-408f-a3b8-9fc7d3d038da roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40442025-06-04T04:48:40.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5339fd7a-542c-408f-a3b8-9fc7d3d038da resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40452025-06-04T04:48:40.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1980 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5339fd7a-542c-408f-a3b8-9fc7d3d038da response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40462025-06-04T04:48:40.918ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c original_time_created = 2025-06-04 04:36:14.609521 UTC target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c time_created = 2025-06-04 04:36:14.609521 UTC
40472025-06-04T04:48:40.918ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.42333ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","time_created":"2025-06-04T04:36:14.609521Z"}
40482025-06-04T04:48:40.930ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40492025-06-04T04:48:40.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40502025-06-04T04:48:40.963ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.297781ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40512025-06-04T04:48:41.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 14a32480-bc5b-49e5-837c-b5ea7160cf96 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40522025-06-04T04:48:41.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 14a32480-bc5b-49e5-837c-b5ea7160cf96 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40532025-06-04T04:48:41.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 14a32480-bc5b-49e5-837c-b5ea7160cf96 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40542025-06-04T04:48:42.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 65e1ffa1-775f-4c2b-9b3a-3ef363dfa2cb roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40552025-06-04T04:48:42.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 65e1ffa1-775f-4c2b-9b3a-3ef363dfa2cb resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40562025-06-04T04:48:42.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2747 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 65e1ffa1-775f-4c2b-9b3a-3ef363dfa2cb response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40572025-06-04T04:48:43.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 605c8f39-b171-4a57-b933-74ad8c50d36a roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40582025-06-04T04:48:43.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 605c8f39-b171-4a57-b933-74ad8c50d36a resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40592025-06-04T04:48:43.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 605c8f39-b171-4a57-b933-74ad8c50d36a response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40602025-06-04T04:48:44.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = cf258fc3-bde4-4e79-8b52-2337a58034f2 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40612025-06-04T04:48:44.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = cf258fc3-bde4-4e79-8b52-2337a58034f2 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40622025-06-04T04:48:44.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = cf258fc3-bde4-4e79-8b52-2337a58034f2 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40632025-06-04T04:48:45.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = d53e9d79-b89c-4d79-9dfc-a3a5bb3a11ed roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40642025-06-04T04:48:45.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = d53e9d79-b89c-4d79-9dfc-a3a5bb3a11ed resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40652025-06-04T04:48:45.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2804 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = d53e9d79-b89c-4d79-9dfc-a3a5bb3a11ed response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40662025-06-04T04:48:46.505ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 610 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = dcff0472-584b-4e55-9a2e-d65df9ba29f8 response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
40672025-06-04T04:48:47.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 8f60c3e3-84a1-4e71-b01b-7bbbaaae5711 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40682025-06-04T04:48:47.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 8f60c3e3-84a1-4e71-b01b-7bbbaaae5711 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40692025-06-04T04:48:47.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 8f60c3e3-84a1-4e71-b01b-7bbbaaae5711 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40702025-06-04T04:48:48.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = ceb5e1e2-f7c2-4e12-804f-dba4109f27f3 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40712025-06-04T04:48:48.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = ceb5e1e2-f7c2-4e12-804f-dba4109f27f3 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40722025-06-04T04:48:48.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2552 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = ceb5e1e2-f7c2-4e12-804f-dba4109f27f3 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40732025-06-04T04:48:49.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = b9ce11f3-4442-4a4c-afdf-955ff84a41f2 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40742025-06-04T04:48:49.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = b9ce11f3-4442-4a4c-afdf-955ff84a41f2 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40752025-06-04T04:48:49.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3084 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = b9ce11f3-4442-4a4c-afdf-955ff84a41f2 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40762025-06-04T04:48:50.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 39cc15fa-cfdc-423e-82c0-3bd6a634a3c6 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40772025-06-04T04:48:50.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 39cc15fa-cfdc-423e-82c0-3bd6a634a3c6 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40782025-06-04T04:48:50.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1842 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 39cc15fa-cfdc-423e-82c0-3bd6a634a3c6 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
40792025-06-04T04:48:50.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
40802025-06-04T04:48:50.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40812025-06-04T04:48:50.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
40822025-06-04T04:48:50.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40832025-06-04T04:48:50.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40842025-06-04T04:48:50.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40852025-06-04T04:48:50.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40862025-06-04T04:48:50.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40872025-06-04T04:48:50.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40882025-06-04T04:48:50.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40892025-06-04T04:48:50.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40902025-06-04T04:48:50.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40912025-06-04T04:48:50.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40922025-06-04T04:48:50.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1dd88a28-32c4-4490-89f2-ae05402d904c, lookup_type: ById(1dd88a28-32c4-4490-89f2-ae05402d904c) } result = Ok(())
40932025-06-04T04:48:50.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40942025-06-04T04:48:50.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40952025-06-04T04:48:50.919ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c original_time_created = 2025-06-04 04:36:14.609521 UTC target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c time_created = 2025-06-04 04:36:14.609521 UTC
40962025-06-04T04:48:50.919ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.322914ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","time_created":"2025-06-04T04:36:14.609521Z"}
40972025-06-04T04:48:50.930ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40982025-06-04T04:48:50.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40992025-06-04T04:48:50.932ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.22991ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41002025-06-04T04:48:51.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = d054b10c-48d4-4637-959d-653a8fc20d5b roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41012025-06-04T04:48:51.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = d054b10c-48d4-4637-959d-653a8fc20d5b resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41022025-06-04T04:48:51.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1838 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = d054b10c-48d4-4637-959d-653a8fc20d5b response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41032025-06-04T04:48:52.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5eac17a3-9dc8-4ee6-b924-87ef35d53014 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41042025-06-04T04:48:52.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5eac17a3-9dc8-4ee6-b924-87ef35d53014 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41052025-06-04T04:48:52.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5eac17a3-9dc8-4ee6-b924-87ef35d53014 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41062025-06-04T04:48:53.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 6a330765-6bbb-4663-836c-76665a83df2f roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41072025-06-04T04:48:53.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 6a330765-6bbb-4663-836c-76665a83df2f resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41082025-06-04T04:48:53.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 6a330765-6bbb-4663-836c-76665a83df2f response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41092025-06-04T04:48:54.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = b3ce7b77-9ee9-496b-b65d-c78dbc4f9da8 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41102025-06-04T04:48:54.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = b3ce7b77-9ee9-496b-b65d-c78dbc4f9da8 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41112025-06-04T04:48:54.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = b3ce7b77-9ee9-496b-b65d-c78dbc4f9da8 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41122025-06-04T04:48:55.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 432910c7-6fe4-4527-a724-5e3a617f3fc8 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41132025-06-04T04:48:55.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 432910c7-6fe4-4527-a724-5e3a617f3fc8 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41142025-06-04T04:48:55.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2576 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 432910c7-6fe4-4527-a724-5e3a617f3fc8 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41152025-06-04T04:48:56.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2f135919-0a71-4cd4-8f2b-5a971acfcc88 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41162025-06-04T04:48:56.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2f135919-0a71-4cd4-8f2b-5a971acfcc88 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41172025-06-04T04:48:56.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2395 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2f135919-0a71-4cd4-8f2b-5a971acfcc88 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41182025-06-04T04:48:56.505ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 868 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = 8d765b61-fdfd-4fc7-b9a3-6b18d8296025 response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
41192025-06-04T04:48:57.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = a248dafa-8eee-4e79-9d00-367cdf6a5556 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41202025-06-04T04:48:57.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = a248dafa-8eee-4e79-9d00-367cdf6a5556 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41212025-06-04T04:48:57.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2568 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = a248dafa-8eee-4e79-9d00-367cdf6a5556 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41222025-06-04T04:48:58.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = d21c83e6-9aad-46d8-bb28-6a5644da0ed7 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41232025-06-04T04:48:58.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = d21c83e6-9aad-46d8-bb28-6a5644da0ed7 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41242025-06-04T04:48:58.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2638 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = d21c83e6-9aad-46d8-bb28-6a5644da0ed7 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41252025-06-04T04:48:59.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = ab9424ee-2032-40a7-89c8-4c617dddcc0c roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41262025-06-04T04:48:59.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = ab9424ee-2032-40a7-89c8-4c617dddcc0c resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41272025-06-04T04:48:59.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2478 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = ab9424ee-2032-40a7-89c8-4c617dddcc0c response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41282025-06-04T04:49:00.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 894c48d2-c0e8-4800-b698-a3191e8db942 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41292025-06-04T04:49:00.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 894c48d2-c0e8-4800-b698-a3191e8db942 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41302025-06-04T04:49:00.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 894c48d2-c0e8-4800-b698-a3191e8db942 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
41312025-06-04T04:49:00.895ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
41322025-06-04T04:49:00.895ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
41332025-06-04T04:49:00.895ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41342025-06-04T04:49:00.895ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
41352025-06-04T04:49:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
41362025-06-04T04:49:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41372025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
41382025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41392025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
41402025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
41412025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41422025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41432025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
41442025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
41452025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
41462025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41472025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 26 reason = Timeout
41482025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
41492025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
41502025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41512025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
41522025-06-04T04:49:00.896ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
41532025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
41542025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41552025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41562025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
41572025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41582025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
41592025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41602025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
41612025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41622025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 26 reason = Timeout
41632025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
41642025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
41652025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41662025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41672025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
41682025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
41692025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
41702025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
41712025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
41722025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41732025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41742025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
41752025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41762025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41772025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41782025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
41792025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41802025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41812025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41822025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41832025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41842025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41852025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41862025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
41872025-06-04T04:49:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
41882025-06-04T04:49:00.897ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1565, tv_nsec: 62455911 } })
41892025-06-04T04:49:00.897ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
41902025-06-04T04:49:00.898ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1565, tv_nsec: 63210473 } })
41912025-06-04T04:49:00.898ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
41922025-06-04T04:49:00.898ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41932025-06-04T04:49:00.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41942025-06-04T04:49:00.900ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41952025-06-04T04:49:00.900ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.510118ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
41962025-06-04T04:49:00.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41972025-06-04T04:49:00.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41982025-06-04T04:49:00.901ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41992025-06-04T04:49:00.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42002025-06-04T04:49:00.902ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42012025-06-04T04:49:00.902ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42022025-06-04T04:49:00.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42032025-06-04T04:49:00.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
42042025-06-04T04:49:00.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42052025-06-04T04:49:00.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42062025-06-04T04:49:00.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
42072025-06-04T04:49:00.904ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42082025-06-04T04:49:00.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42092025-06-04T04:49:00.905ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42102025-06-04T04:49:00.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
42112025-06-04T04:49:00.907ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42122025-06-04T04:49:00.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42132025-06-04T04:49:00.908ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 12.298927ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
42142025-06-04T04:49:00.909ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42152025-06-04T04:49:00.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42162025-06-04T04:49:00.910ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42172025-06-04T04:49:00.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42182025-06-04T04:49:00.912ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1565, tv_nsec: 77564861 } })
42192025-06-04T04:49:00.913ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36
42202025-06-04T04:49:00.945ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.631248ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
42212025-06-04T04:49:00.952ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 56.02189ms iteration = 26 status = {"errors":[],"requests_created_ok":[]}
42222025-06-04T04:49:00.958ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42232025-06-04T04:49:00.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42242025-06-04T04:49:00.959ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42252025-06-04T04:49:00.959ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
42262025-06-04T04:49:00.959ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42272025-06-04T04:49:00.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42282025-06-04T04:49:00.959ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42292025-06-04T04:49:00.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
42302025-06-04T04:49:00.960ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42312025-06-04T04:49:00.961ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42322025-06-04T04:49:00.961ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 65.331732ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
42332025-06-04T04:49:00.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
42342025-06-04T04:49:00.964ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42352025-06-04T04:49:00.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42362025-06-04T04:49:00.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42372025-06-04T04:49:00.965ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42382025-06-04T04:49:00.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42392025-06-04T04:49:00.965ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42402025-06-04T04:49:00.966ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42412025-06-04T04:49:00.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42422025-06-04T04:49:00.967ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42432025-06-04T04:49:00.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42442025-06-04T04:49:00.968ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42452025-06-04T04:49:00.968ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42462025-06-04T04:49:00.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42472025-06-04T04:49:00.968ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42482025-06-04T04:49:00.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42492025-06-04T04:49:00.970ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42502025-06-04T04:49:00.970ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42512025-06-04T04:49:00.970ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42522025-06-04T04:49:00.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42532025-06-04T04:49:00.971ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42542025-06-04T04:49:00.971ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
42552025-06-04T04:49:00.971ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 75.036189ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
42562025-06-04T04:49:00.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
42572025-06-04T04:49:00.972ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42582025-06-04T04:49:00.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42592025-06-04T04:49:00.972ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
42602025-06-04T04:49:00.972ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
42612025-06-04T04:49:00.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
42622025-06-04T04:49:00.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1dd88a28-32c4-4490-89f2-ae05402d904c, lookup_type: ById(1dd88a28-32c4-4490-89f2-ae05402d904c) } result = Ok(())
42632025-06-04T04:49:00.973ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42642025-06-04T04:49:00.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42652025-06-04T04:49:00.988ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
42662025-06-04T04:49:00.988ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42672025-06-04T04:49:00.989ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c031e065-bfc2-4b57-bb6d-9d7be1e4aeab", "content-length": "26", "date": "Wed, 04 Jun 2025 04:49:00 GMT"} })
42682025-06-04T04:49:00.989ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42692025-06-04T04:49:00.990ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42702025-06-04T04:49:00.997ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
42712025-06-04T04:49:00.997ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42722025-06-04T04:49:00.998ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "84aa5fa7-6251-4712-84b8-8dcc655de900", "content-length": "26", "date": "Wed, 04 Jun 2025 04:49:00 GMT"} })
42732025-06-04T04:49:00.998ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42742025-06-04T04:49:00.999ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42752025-06-04T04:49:01.002ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42762025-06-04T04:49:01.002ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
42772025-06-04T04:49:01.002ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42782025-06-04T04:49:01.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42792025-06-04T04:49:01.003ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 107.38423ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42802025-06-04T04:49:01.005ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42812025-06-04T04:49:01.008ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cb8aa4e2-773a-4f3e-86b7-f32104e9c4de, lookup_type: ById(cb8aa4e2-773a-4f3e-86b7-f32104e9c4de) } result = Ok(())
42822025-06-04T04:49:01.008ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42832025-06-04T04:49:01.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42842025-06-04T04:49:01.041ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 zone_address = fd00:1122:3344:101::2
42852025-06-04T04:49:01.041ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42862025-06-04T04:49:01.041ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2ab0844-d779-488c-94a1-f94900677fe8", "content-length": "26", "date": "Wed, 04 Jun 2025 04:49:00 GMT"} })
42872025-06-04T04:49:01.041ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42882025-06-04T04:49:01.043ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36
42892025-06-04T04:49:01.046ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42902025-06-04T04:49:01.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42912025-06-04T04:49:01.089ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 193.04701ms iteration = 29 status = {"physical_disks_added":0}
42922025-06-04T04:49:01.098ZINFOnexus (BackgroundTasks): VPC route manager sled cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
42932025-06-04T04:49:01.098ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42942025-06-04T04:49:01.100ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 203.937495ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
42952025-06-04T04:49:01.103ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 206.797458ms iteration = 26 status = 0
42962025-06-04T04:49:01.105ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42972025-06-04T04:49:01.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42982025-06-04T04:49:01.107ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 212.553326ms iteration = 26 status = null
42992025-06-04T04:49:01.112ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c original_time_created = 2025-06-04 04:36:14.609521 UTC target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c time_created = 2025-06-04 04:36:14.609521 UTC
43002025-06-04T04:49:01.112ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 216.211742ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","time_created":"2025-06-04T04:36:14.609521Z"}
43012025-06-04T04:49:01.141ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43022025-06-04T04:49:01.141ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
43032025-06-04T04:49:01.141ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 245.249652ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
43042025-06-04T04:49:01.142ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
43052025-06-04T04:49:01.142ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 245.945873ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
43062025-06-04T04:49:01.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
43072025-06-04T04:49:01.143ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43082025-06-04T04:49:01.145ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
43092025-06-04T04:49:01.145ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
43102025-06-04T04:49:01.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
43112025-06-04T04:49:01.148ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3c452de-91ef-4cee-ba71-1c74f7430083", "content-length": "372", "date": "Wed, 04 Jun 2025 04:49:01 GMT"} })
43122025-06-04T04:49:01.148ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43132025-06-04T04:49:01.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43142025-06-04T04:49:01.173ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 278.214343ms iteration = 26 status = {}
43152025-06-04T04:49:01.186ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
43162025-06-04T04:49:01.186ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 289.794438ms iteration = 26 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
43172025-06-04T04:49:01.205ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
43182025-06-04T04:49:01.205ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
43192025-06-04T04:49:01.205ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ee2c7d12-1fcb-4629-80a6-1a048299a572", "date": "Wed, 04 Jun 2025 04:49:01 GMT"} })
43202025-06-04T04:49:01.205ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43212025-06-04T04:49:01.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43222025-06-04T04:49:01.208ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43232025-06-04T04:49:01.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43242025-06-04T04:49:01.212ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43252025-06-04T04:49:01.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43262025-06-04T04:49:01.215ZINFOnexus (BackgroundTasks): VPC route manager sled cb8aa4e2-773a-4f3e-86b7-f32104e9c4de push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
43272025-06-04T04:49:01.215ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43282025-06-04T04:49:01.215ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "63334b2a-8a60-44aa-83f6-a192754d88e0", "date": "Wed, 04 Jun 2025 04:49:01 GMT"} })
43292025-06-04T04:49:01.217ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 321.543391ms iteration = 27 status = {}
43302025-06-04T04:49:01.221ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43312025-06-04T04:49:01.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43322025-06-04T04:49:01.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 8eca3a1e-f4a3-4fac-b146-834bee52d199 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
43332025-06-04T04:49:01.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 8eca3a1e-f4a3-4fac-b146-834bee52d199 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
43342025-06-04T04:49:01.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2020 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 8eca3a1e-f4a3-4fac-b146-834bee52d199 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
43352025-06-04T04:49:01.240ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43362025-06-04T04:49:01.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43372025-06-04T04:49:01.241ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: a0769b7e-afb1-46f8-b225-eac4dddfaf8d, rack_id: 5a147cfa-15ac-4bf0-8777-c82b354c8c36, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(913c54af-e122-4277-b509-f8a495f24eae) } rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch_location = Switch0
43382025-06-04T04:49:01.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43392025-06-04T04:49:01.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43402025-06-04T04:49:01.255ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
43412025-06-04T04:49:01.255ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 913c54af-e122-4277-b509-f8a495f24eae
43422025-06-04T04:49:01.256ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43432025-06-04T04:49:01.256ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
43442025-06-04T04:49:01.256ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
43452025-06-04T04:49:01.256ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43462025-06-04T04:49:01.256ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43472025-06-04T04:49:01.256ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43482025-06-04T04:49:01.256ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
43492025-06-04T04:49:01.256ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43502025-06-04T04:49:01.256ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
43512025-06-04T04:49:01.256ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36
43522025-06-04T04:49:01.256ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43532025-06-04T04:49:01.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43542025-06-04T04:49:01.258ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43552025-06-04T04:49:01.258ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43562025-06-04T04:49:01.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43572025-06-04T04:49:01.260ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch_location = Switch0
43582025-06-04T04:49:01.260ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
43592025-06-04T04:49:01.291ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43602025-06-04T04:49:01.293ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43612025-06-04T04:49:01.293ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43622025-06-04T04:49:01.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43632025-06-04T04:49:01.362ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "de14d96f-adac-405e-b7f5-3b2f2ccd3bcb", "date": "Wed, 04 Jun 2025 04:49:01 GMT"} })
43642025-06-04T04:49:01.362ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch = Switch0
43652025-06-04T04:49:01.362ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
43662025-06-04T04:49:01.362ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b0f8ece-be06-4b35-ba4f-45fc6952d184", "content-length": "682", "date": "Wed, 04 Jun 2025 04:49:01 GMT"} })
43672025-06-04T04:49:01.362ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43682025-06-04T04:49:01.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43692025-06-04T04:49:01.365ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43702025-06-04T04:49:01.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43712025-06-04T04:49:01.368ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43722025-06-04T04:49:01.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43732025-06-04T04:49:01.370ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43742025-06-04T04:49:01.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43752025-06-04T04:49:01.378ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 481.828413ms iteration = 26 status = {}
43762025-06-04T04:49:01.388ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
43772025-06-04T04:49:01.388ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ba26e79-5921-4bee-8e71-da2e88505ae9", "content-length": "691", "date": "Wed, 04 Jun 2025 04:49:01 GMT"} })
43782025-06-04T04:49:01.388ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
43792025-06-04T04:49:01.388ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
43802025-06-04T04:49:01.388ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
43812025-06-04T04:49:01.389ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 493.616842ms iteration = 27 status = {}
43822025-06-04T04:49:02.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 49a755c7-fd00-4fe7-a40e-9a118b16ec8e roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
43832025-06-04T04:49:02.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 49a755c7-fd00-4fe7-a40e-9a118b16ec8e resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
43842025-06-04T04:49:02.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2480 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 49a755c7-fd00-4fe7-a40e-9a118b16ec8e response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
43852025-06-04T04:49:03.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 0e73f089-2b61-4eaf-8773-fc6ecc58f2de roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
43862025-06-04T04:49:03.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 0e73f089-2b61-4eaf-8773-fc6ecc58f2de resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
43872025-06-04T04:49:03.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2491 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 0e73f089-2b61-4eaf-8773-fc6ecc58f2de response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
43882025-06-04T04:49:04.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 64417eb1-ea26-4333-8555-39335ccecf5f roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
43892025-06-04T04:49:04.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 64417eb1-ea26-4333-8555-39335ccecf5f resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
43902025-06-04T04:49:04.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 64417eb1-ea26-4333-8555-39335ccecf5f response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
43912025-06-04T04:49:05.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f2292272-49c6-4047-a8df-ce0d1e84bc4c roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
43922025-06-04T04:49:05.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f2292272-49c6-4047-a8df-ce0d1e84bc4c resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
43932025-06-04T04:49:05.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2753 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f2292272-49c6-4047-a8df-ce0d1e84bc4c response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
43942025-06-04T04:49:06.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 0287aaa5-ad5b-489d-9fe3-76488ebf53d1 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
43952025-06-04T04:49:06.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 0287aaa5-ad5b-489d-9fe3-76488ebf53d1 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
43962025-06-04T04:49:06.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2429 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 0287aaa5-ad5b-489d-9fe3-76488ebf53d1 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
43972025-06-04T04:49:06.505ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 612 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = 47411aba-96d8-4e61-a327-2dbbbe2cb4c6 response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
43982025-06-04T04:49:07.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 065ab5ae-9051-4ef6-ae7d-3fa0dc3f0cef roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
43992025-06-04T04:49:07.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 065ab5ae-9051-4ef6-ae7d-3fa0dc3f0cef resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44002025-06-04T04:49:07.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2571 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 065ab5ae-9051-4ef6-ae7d-3fa0dc3f0cef response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44012025-06-04T04:49:08.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 68760c52-08aa-470d-876c-e05850bef1bb roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44022025-06-04T04:49:08.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 68760c52-08aa-470d-876c-e05850bef1bb resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44032025-06-04T04:49:08.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2724 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 68760c52-08aa-470d-876c-e05850bef1bb response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44042025-06-04T04:49:09.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f0cf078e-614b-4cc8-8311-143f1d96efa2 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44052025-06-04T04:49:09.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f0cf078e-614b-4cc8-8311-143f1d96efa2 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44062025-06-04T04:49:09.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f0cf078e-614b-4cc8-8311-143f1d96efa2 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44072025-06-04T04:49:10.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5e3d81ac-948b-4b79-93a3-1d5ec16dd340 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44082025-06-04T04:49:10.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5e3d81ac-948b-4b79-93a3-1d5ec16dd340 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44092025-06-04T04:49:10.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2449 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5e3d81ac-948b-4b79-93a3-1d5ec16dd340 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44102025-06-04T04:49:10.896ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
44112025-06-04T04:49:10.896ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
44122025-06-04T04:49:10.896ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44132025-06-04T04:49:10.896ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44142025-06-04T04:49:10.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44152025-06-04T04:49:10.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44162025-06-04T04:49:10.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44172025-06-04T04:49:10.898ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44182025-06-04T04:49:10.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44192025-06-04T04:49:10.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44202025-06-04T04:49:10.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44212025-06-04T04:49:10.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44222025-06-04T04:49:10.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44232025-06-04T04:49:10.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44242025-06-04T04:49:10.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44252025-06-04T04:49:10.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1dd88a28-32c4-4490-89f2-ae05402d904c, lookup_type: ById(1dd88a28-32c4-4490-89f2-ae05402d904c) } result = Ok(())
44262025-06-04T04:49:10.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44272025-06-04T04:49:10.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44282025-06-04T04:49:10.921ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c original_time_created = 2025-06-04 04:36:14.609521 UTC target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c time_created = 2025-06-04 04:36:14.609521 UTC
44292025-06-04T04:49:10.921ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.122502ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","time_created":"2025-06-04T04:36:14.609521Z"}
44302025-06-04T04:49:10.932ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.968926ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44312025-06-04T04:49:11.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 0ef1a982-70a8-410b-aee2-0280ffb358c6 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44322025-06-04T04:49:11.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 0ef1a982-70a8-410b-aee2-0280ffb358c6 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44332025-06-04T04:49:11.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 0ef1a982-70a8-410b-aee2-0280ffb358c6 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44342025-06-04T04:49:12.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 4cbb1407-0523-468f-bfd1-966953618491 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44352025-06-04T04:49:12.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 4cbb1407-0523-468f-bfd1-966953618491 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44362025-06-04T04:49:12.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2610 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 4cbb1407-0523-468f-bfd1-966953618491 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44372025-06-04T04:49:13.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 14d4a869-eb09-4ec9-aca7-99b90e647f23 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44382025-06-04T04:49:13.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 14d4a869-eb09-4ec9-aca7-99b90e647f23 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44392025-06-04T04:49:13.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1886 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 14d4a869-eb09-4ec9-aca7-99b90e647f23 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44402025-06-04T04:49:14.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 0313b2c6-94d4-48f5-9105-c81eda6e64e0 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44412025-06-04T04:49:14.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 0313b2c6-94d4-48f5-9105-c81eda6e64e0 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44422025-06-04T04:49:14.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3039 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 0313b2c6-94d4-48f5-9105-c81eda6e64e0 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44432025-06-04T04:49:15.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = cf2a9217-16c6-4955-b81b-4356dd247111 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44442025-06-04T04:49:15.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = cf2a9217-16c6-4955-b81b-4356dd247111 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44452025-06-04T04:49:15.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2197 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = cf2a9217-16c6-4955-b81b-4356dd247111 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44462025-06-04T04:49:16.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 111d53da-bcbc-462d-b194-5c5346e06390 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44472025-06-04T04:49:16.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 111d53da-bcbc-462d-b194-5c5346e06390 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44482025-06-04T04:49:16.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2821 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 111d53da-bcbc-462d-b194-5c5346e06390 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44492025-06-04T04:49:16.505ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 822 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = 6f06798d-8b89-4fe4-ab0f-faf160c61853 response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
44502025-06-04T04:49:17.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 7e29d97f-614c-4105-8a87-6e348e6313ed roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44512025-06-04T04:49:17.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 7e29d97f-614c-4105-8a87-6e348e6313ed resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44522025-06-04T04:49:17.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3767 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 7e29d97f-614c-4105-8a87-6e348e6313ed response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44532025-06-04T04:49:18.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = d32616d0-755a-4159-9d8e-d1eea89ade16 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44542025-06-04T04:49:18.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = d32616d0-755a-4159-9d8e-d1eea89ade16 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44552025-06-04T04:49:18.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1704 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = d32616d0-755a-4159-9d8e-d1eea89ade16 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44562025-06-04T04:49:19.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = e40218de-d0ff-4023-ad5f-381c8c5afb47 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44572025-06-04T04:49:19.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = e40218de-d0ff-4023-ad5f-381c8c5afb47 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44582025-06-04T04:49:19.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2777 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = e40218de-d0ff-4023-ad5f-381c8c5afb47 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44592025-06-04T04:49:20.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 97537305-b8e0-487c-a02f-3f1de0b28164 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44602025-06-04T04:49:20.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 97537305-b8e0-487c-a02f-3f1de0b28164 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44612025-06-04T04:49:20.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2479 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 97537305-b8e0-487c-a02f-3f1de0b28164 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44622025-06-04T04:49:20.896ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
44632025-06-04T04:49:20.896ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44642025-06-04T04:49:20.896ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
44652025-06-04T04:49:20.896ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44662025-06-04T04:49:20.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44672025-06-04T04:49:20.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44682025-06-04T04:49:20.898ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44692025-06-04T04:49:20.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44702025-06-04T04:49:20.928ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44712025-06-04T04:49:20.931ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.040412ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44722025-06-04T04:49:20.931ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44732025-06-04T04:49:20.931ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44742025-06-04T04:49:20.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44752025-06-04T04:49:20.933ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44762025-06-04T04:49:20.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44772025-06-04T04:49:20.935ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44782025-06-04T04:49:20.938ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1dd88a28-32c4-4490-89f2-ae05402d904c, lookup_type: ById(1dd88a28-32c4-4490-89f2-ae05402d904c) } result = Ok(())
44792025-06-04T04:49:20.938ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44802025-06-04T04:49:20.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44812025-06-04T04:49:20.950ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c original_time_created = 2025-06-04 04:36:14.609521 UTC target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c time_created = 2025-06-04 04:36:14.609521 UTC
44822025-06-04T04:49:20.950ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.526877ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","time_created":"2025-06-04T04:36:14.609521Z"}
44832025-06-04T04:49:21.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 16ef2453-2e64-4202-91e4-4255cc457fc9 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44842025-06-04T04:49:21.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 16ef2453-2e64-4202-91e4-4255cc457fc9 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44852025-06-04T04:49:21.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2610 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 16ef2453-2e64-4202-91e4-4255cc457fc9 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44862025-06-04T04:49:22.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3c920c5c-b82a-4220-b235-4dfc7d68e9fe roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44872025-06-04T04:49:22.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3c920c5c-b82a-4220-b235-4dfc7d68e9fe resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44882025-06-04T04:49:22.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1860 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 3c920c5c-b82a-4220-b235-4dfc7d68e9fe response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44892025-06-04T04:49:23.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 1602907e-ddbe-43a2-912d-37cf05b067ee roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44902025-06-04T04:49:23.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 1602907e-ddbe-43a2-912d-37cf05b067ee resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44912025-06-04T04:49:23.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2602 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 1602907e-ddbe-43a2-912d-37cf05b067ee response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44922025-06-04T04:49:24.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2eb09e34-037b-4cb7-8388-7ee01d4b4163 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44932025-06-04T04:49:24.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2eb09e34-037b-4cb7-8388-7ee01d4b4163 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44942025-06-04T04:49:24.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2439 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2eb09e34-037b-4cb7-8388-7ee01d4b4163 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44952025-06-04T04:49:25.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 43d8d7f2-9f31-4bc1-be05-6ef4cb711a28 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44962025-06-04T04:49:25.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 43d8d7f2-9f31-4bc1-be05-6ef4cb711a28 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44972025-06-04T04:49:25.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2658 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 43d8d7f2-9f31-4bc1-be05-6ef4cb711a28 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
44982025-06-04T04:49:26.505ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 862 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = a8575719-0f7b-4f7d-9d33-ee295a430209 response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
44992025-06-04T04:49:26.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = cb950da6-3a6a-4302-87c9-671815512d0b roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
45002025-06-04T04:49:26.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = cb950da6-3a6a-4302-87c9-671815512d0b resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
45012025-06-04T04:49:26.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2708 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = cb950da6-3a6a-4302-87c9-671815512d0b response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
45022025-06-04T04:49:27.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 28cf95c3-1873-4ef7-9914-a9516929bb06 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
45032025-06-04T04:49:27.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 28cf95c3-1873-4ef7-9914-a9516929bb06 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
45042025-06-04T04:49:27.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2576 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 28cf95c3-1873-4ef7-9914-a9516929bb06 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
45052025-06-04T04:49:28.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 84f676ca-14a3-4f24-b01d-1560656c25e0 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
45062025-06-04T04:49:28.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 84f676ca-14a3-4f24-b01d-1560656c25e0 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
45072025-06-04T04:49:28.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2105 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 84f676ca-14a3-4f24-b01d-1560656c25e0 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
45082025-06-04T04:49:29.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = cdc0f057-7395-4160-b05f-7c96f5731c68 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
45092025-06-04T04:49:29.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = cdc0f057-7395-4160-b05f-7c96f5731c68 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
45102025-06-04T04:49:29.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = cdc0f057-7395-4160-b05f-7c96f5731c68 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
45112025-06-04T04:49:30.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 23ff406f-2026-4d88-8b04-d9dbb5c94c35 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
45122025-06-04T04:49:30.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 23ff406f-2026-4d88-8b04-d9dbb5c94c35 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
45132025-06-04T04:49:30.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2785 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 23ff406f-2026-4d88-8b04-d9dbb5c94c35 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
45142025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
45152025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
45162025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
45172025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
45182025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
45192025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45202025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
45212025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
45222025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
45232025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45242025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
45252025-06-04T04:49:30.895ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-06-04 04:39:30.895289124 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
45262025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
45272025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
45282025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45292025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
45302025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
45312025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
45322025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45332025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
45342025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
45352025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45362025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45372025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
45382025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
45392025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
45402025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
45412025-06-04T04:49:30.895ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
45422025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
45432025-06-04T04:49:30.895ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c
45442025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
45452025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
45462025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45472025-06-04T04:49:30.895ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
45482025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
45492025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.281\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c"}
45502025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45512025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45522025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
45532025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
45542025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45552025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45562025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 27 reason = Timeout
45572025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
45582025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
45592025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
45602025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
45612025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
45622025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45632025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45642025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45652025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
45662025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
45672025-06-04T04:49:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
45682025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45692025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45702025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45712025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45722025-06-04T04:49:30.896ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3147fdc0-57b9-465b-97b1-724db3a98549.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fd2bb11e-a66c-4a76-9d9e-ddc3f90ca952.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fd2bb11e-a66c-4a76-9d9e-ddc3f90ca952.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1595, tv_nsec: 60570237 } })
45732025-06-04T04:49:30.896ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6bd72d79-86a4-4394-904a-eda88bc21fd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("badd8271-e80d-44a0-993c-76a669a9eadb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f664b51a-ef20-45b7-9cac-a2aa17e449b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f664b51a-ef20-45b7-9cac-a2aa17e449b7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1595, tv_nsec: 60570317 } })
45742025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45752025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
45762025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45772025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
45782025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45792025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45802025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45812025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45822025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45832025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45842025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45852025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45862025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
45872025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45882025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
45892025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45902025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
45912025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
45922025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
45932025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
45942025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45952025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 14 reason = Timeout
45962025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
45972025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 14 reason = Timeout
45982025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
45992025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
46002025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
46012025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
46022025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
46032025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 27 reason = Timeout
46042025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
46052025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
46062025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46072025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
46082025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.331911ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
46092025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
46102025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.438742ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
46112025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46122025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
46132025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
46142025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
46152025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
46162025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
46172025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46182025-06-04T04:49:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
46192025-06-04T04:49:30.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
46202025-06-04T04:49:30.898ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1595, tv_nsec: 63324319 } })
46212025-06-04T04:49:30.898ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
46222025-06-04T04:49:30.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46232025-06-04T04:49:30.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46242025-06-04T04:49:30.899ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.828948ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
46252025-06-04T04:49:30.899ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46262025-06-04T04:49:30.899ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-06-04 04:39:30.895289124 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
46272025-06-04T04:49:30.899ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.61613ms iteration = 14 status = {"expiration":"2025-06-04T04:39:30.895289124Z","pruned":[]}
46282025-06-04T04:49:30.901ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1595, tv_nsec: 65754485 } })
46292025-06-04T04:49:30.901ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
46302025-06-04T04:49:30.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46312025-06-04T04:49:30.902ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
46322025-06-04T04:49:30.902ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46332025-06-04T04:49:30.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46342025-06-04T04:49:30.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46352025-06-04T04:49:30.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46362025-06-04T04:49:30.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46372025-06-04T04:49:30.905ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46382025-06-04T04:49:30.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46392025-06-04T04:49:30.905ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46402025-06-04T04:49:30.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
46412025-06-04T04:49:30.908ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46422025-06-04T04:49:30.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46432025-06-04T04:49:30.916ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.139125ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
46442025-06-04T04:49:30.953ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46452025-06-04T04:49:30.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
46462025-06-04T04:49:30.956ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
46472025-06-04T04:49:30.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
46482025-06-04T04:49:30.960ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
46492025-06-04T04:49:30.960ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 63.834319ms iteration = 14 status = {"by_rx":{},"error":null}
46502025-06-04T04:49:30.962ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46512025-06-04T04:49:30.965ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46522025-06-04T04:49:30.966ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
46532025-06-04T04:49:30.969ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46542025-06-04T04:49:30.969ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46552025-06-04T04:49:30.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46562025-06-04T04:49:30.969ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46572025-06-04T04:49:30.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46582025-06-04T04:49:30.971ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46592025-06-04T04:49:30.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46602025-06-04T04:49:30.974ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46612025-06-04T04:49:30.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46622025-06-04T04:49:30.974ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46632025-06-04T04:49:30.975ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
46642025-06-04T04:49:30.975ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46652025-06-04T04:49:30.975ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46662025-06-04T04:49:30.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46672025-06-04T04:49:30.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46682025-06-04T04:49:30.976ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 79.614939ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
46692025-06-04T04:49:30.976ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
46702025-06-04T04:49:30.976ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
46712025-06-04T04:49:30.976ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 79.838582ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
46722025-06-04T04:49:30.976ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46732025-06-04T04:49:30.978ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46742025-06-04T04:49:30.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46752025-06-04T04:49:30.979ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
46762025-06-04T04:49:30.979ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46772025-06-04T04:49:30.979ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
46782025-06-04T04:49:30.979ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
46792025-06-04T04:49:30.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
46802025-06-04T04:49:30.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
46812025-06-04T04:49:30.981ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46822025-06-04T04:49:30.984ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
46832025-06-04T04:49:30.984ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46842025-06-04T04:49:30.984ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
46852025-06-04T04:49:30.984ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46862025-06-04T04:49:30.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46872025-06-04T04:49:30.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46882025-06-04T04:49:30.986ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46892025-06-04T04:49:30.986ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 90.371822ms iteration = 14 status = {"dispatched":[],"errors":[],"glob_version":"146.0.0","globs_reprocessed":{},"no_receivers":[]}
46902025-06-04T04:49:30.986ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46912025-06-04T04:49:30.988ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46922025-06-04T04:49:30.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46932025-06-04T04:49:30.989ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46942025-06-04T04:49:30.989ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46952025-06-04T04:49:30.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46962025-06-04T04:49:30.990ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46972025-06-04T04:49:30.990ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46982025-06-04T04:49:30.990ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 93.510789ms iteration = 27 status = {"errors":[],"requests_created_ok":[]}
46992025-06-04T04:49:30.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47002025-06-04T04:49:30.991ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 94.817429ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
47012025-06-04T04:49:30.992ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47022025-06-04T04:49:30.993ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47032025-06-04T04:49:30.993ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cb8aa4e2-773a-4f3e-86b7-f32104e9c4de.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1595, tv_nsec: 158426492 } })
47042025-06-04T04:49:30.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47052025-06-04T04:49:30.994ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36
47062025-06-04T04:49:30.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
47072025-06-04T04:49:31.024ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
47082025-06-04T04:49:31.041ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
47092025-06-04T04:49:31.041ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
47102025-06-04T04:49:31.041ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
47112025-06-04T04:49:31.041ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47122025-06-04T04:49:31.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47132025-06-04T04:49:31.044ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 148.90514ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47142025-06-04T04:49:31.046ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47152025-06-04T04:49:31.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47162025-06-04T04:49:31.047ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47172025-06-04T04:49:31.047ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47182025-06-04T04:49:31.049ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 154.16112ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47192025-06-04T04:49:31.051ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
47202025-06-04T04:49:31.052ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 155.838235ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
47212025-06-04T04:49:31.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
47222025-06-04T04:49:31.052ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47232025-06-04T04:49:31.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
47242025-06-04T04:49:31.053ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47252025-06-04T04:49:31.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47262025-06-04T04:49:31.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47272025-06-04T04:49:31.055ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47282025-06-04T04:49:31.055ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
47292025-06-04T04:49:31.055ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47302025-06-04T04:49:31.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47312025-06-04T04:49:31.056ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47322025-06-04T04:49:31.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47332025-06-04T04:49:31.058ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47342025-06-04T04:49:31.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47352025-06-04T04:49:31.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47362025-06-04T04:49:31.060ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
47372025-06-04T04:49:31.060ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47382025-06-04T04:49:31.062ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
47392025-06-04T04:49:31.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
47402025-06-04T04:49:31.063ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47412025-06-04T04:49:31.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1dd88a28-32c4-4490-89f2-ae05402d904c, lookup_type: ById(1dd88a28-32c4-4490-89f2-ae05402d904c) } result = Ok(())
47422025-06-04T04:49:31.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47432025-06-04T04:49:31.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cb8aa4e2-773a-4f3e-86b7-f32104e9c4de, lookup_type: ById(cb8aa4e2-773a-4f3e-86b7-f32104e9c4de) } result = Ok(())
47442025-06-04T04:49:31.064ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47452025-06-04T04:49:31.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47462025-06-04T04:49:31.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47472025-06-04T04:49:31.065ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
47482025-06-04T04:49:31.065ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47492025-06-04T04:49:31.065ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "41b887f9-a932-43f8-9ba5-ce9d0b42ac48", "content-length": "26", "date": "Wed, 04 Jun 2025 04:49:30 GMT"} })
47502025-06-04T04:49:31.065ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47512025-06-04T04:49:31.065ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47522025-06-04T04:49:31.065ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47532025-06-04T04:49:31.065ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47542025-06-04T04:49:31.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47552025-06-04T04:49:31.066ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 170.316455ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47562025-06-04T04:49:31.067ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
47572025-06-04T04:49:31.067ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
47582025-06-04T04:49:31.067ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 171.449112ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
47592025-06-04T04:49:31.067ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 172.067391ms iteration = 27 status = 0
47602025-06-04T04:49:31.067ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47612025-06-04T04:49:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
47622025-06-04T04:49:31.068ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
47632025-06-04T04:49:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
47642025-06-04T04:49:31.074ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 179.083307ms iteration = 30 status = {"physical_disks_added":0}
47652025-06-04T04:49:31.078ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c original_time_created = 2025-06-04 04:36:14.609521 UTC target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c time_created = 2025-06-04 04:36:14.609521 UTC
47662025-06-04T04:49:31.078ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 182.757124ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","time_created":"2025-06-04T04:36:14.609521Z"}
47672025-06-04T04:49:31.080ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
47682025-06-04T04:49:31.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
47692025-06-04T04:49:31.081ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
47702025-06-04T04:49:31.081ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
47712025-06-04T04:49:31.081ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
47722025-06-04T04:49:31.081ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47732025-06-04T04:49:31.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47742025-06-04T04:49:31.084ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47752025-06-04T04:49:31.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
47762025-06-04T04:49:31.088ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47772025-06-04T04:49:31.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47782025-06-04T04:49:31.102ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 205.783834ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
47792025-06-04T04:49:31.105ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
47802025-06-04T04:49:31.105ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 787b83fc-6b83-4eec-b3a2-7c7c59871d86 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
47812025-06-04T04:49:31.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47822025-06-04T04:49:31.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47832025-06-04T04:49:31.111ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47842025-06-04T04:49:31.111ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
47852025-06-04T04:49:31.111ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 215.680163ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
47862025-06-04T04:49:31.112ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47872025-06-04T04:49:31.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47882025-06-04T04:49:31.113ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
47892025-06-04T04:49:31.113ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47902025-06-04T04:49:31.113ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8458e340-b051-4a09-9769-73cdcdecd20d", "content-length": "26", "date": "Wed, 04 Jun 2025 04:49:30 GMT"} })
47912025-06-04T04:49:31.114ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47922025-06-04T04:49:31.115ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47932025-06-04T04:49:31.115ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47942025-06-04T04:49:31.117ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
47952025-06-04T04:49:31.117ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47962025-06-04T04:49:31.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47972025-06-04T04:49:31.120ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47982025-06-04T04:49:31.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47992025-06-04T04:49:31.124ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
48002025-06-04T04:49:31.124ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 228.796103ms iteration = 27 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
48012025-06-04T04:49:31.146ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
48022025-06-04T04:49:31.147ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ce77201a-6012-44b3-bdd1-aa82b5d93c9b dns_zone_name = oxide.test found_so_far = 0 version = 2
48032025-06-04T04:49:31.147ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48042025-06-04T04:49:31.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48052025-06-04T04:49:31.148ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48062025-06-04T04:49:31.151ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48072025-06-04T04:49:31.151ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
48082025-06-04T04:49:31.151ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48092025-06-04T04:49:31.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48102025-06-04T04:49:31.154ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
48112025-06-04T04:49:31.154ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48122025-06-04T04:49:31.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48132025-06-04T04:49:31.154ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ce77201a-6012-44b3-bdd1-aa82b5d93c9b dns_zone_name = oxide.test found_so_far = 4 version = 2
48142025-06-04T04:49:31.154ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
48152025-06-04T04:49:31.154ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-06-04 04:36:32.761780 UTC dns_group = external generation = 2
48162025-06-04T04:49:31.154ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 259.466778ms iteration = 14 status = {"generation":2}
48172025-06-04T04:49:31.157ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 787b83fc-6b83-4eec-b3a2-7c7c59871d86 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
48182025-06-04T04:49:31.157ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
48192025-06-04T04:49:31.157ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-06-04 04:36:31.280949 UTC dns_group = internal generation = 1
48202025-06-04T04:49:31.157ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 262.548754ms iteration = 14 status = {"generation":1}
48212025-06-04T04:49:31.162ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 zone_address = fd00:1122:3344:101::2
48222025-06-04T04:49:31.162ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48232025-06-04T04:49:31.162ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6649d8ac-4203-49f6-8a34-1452cfcbe231", "content-length": "26", "date": "Wed, 04 Jun 2025 04:49:30 GMT"} })
48242025-06-04T04:49:31.162ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48252025-06-04T04:49:31.169ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36
48262025-06-04T04:49:31.177ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-06-04T04:36:26.716717Z, time_modified: 2025-06-04T04:36:26.716717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 6ac9285f-aca7-426a-86f8-a677f8a85ac2, db_silo: Silo { identity: SiloIdentity { id: 6ac9285f-aca7-426a-86f8-a677f8a85ac2, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-04T04:36:32.675073Z, time_modified: 2025-06-04T04:36:32.675073Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "26b91f4e65966da67879de126c5f5f1398a4ef21b95a2113db132d6cfa56d902" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 6ac9285f-aca7-426a-86f8-a677f8a85ac2, db_silo: Silo { identity: SiloIdentity { id: 6ac9285f-aca7-426a-86f8-a677f8a85ac2, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-04T04:36:32.675073Z, time_modified: 2025-06-04T04:36:32.675073Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "26b91f4e65966da67879de126c5f5f1398a4ef21b95a2113db132d6cfa56d902" }] }) }
48272025-06-04T04:49:31.177ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 281.707956ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"6ac9285f-aca7-426a-86f8-a677f8a85ac2","tls_certs":["26b91f4e65966da67879de126c5f5f1398a4ef21b95a2113db132d6cfa56d902"]}},"default_endpoint":{"silo_id":"6ac9285f-aca7-426a-86f8-a677f8a85ac2","tls_certs":["26b91f4e65966da67879de126c5f5f1398a4ef21b95a2113db132d6cfa56d902"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
48282025-06-04T04:49:31.201ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
48292025-06-04T04:49:31.201ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "a223413f-b522-44ff-97b7-310d265f99ed", "date": "Wed, 04 Jun 2025 04:49:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48302025-06-04T04:49:31.201ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48312025-06-04T04:49:31.205ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "64fbf113-24d4-4622-a1b7-e210999a83af", "date": "Wed, 04 Jun 2025 04:49:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48322025-06-04T04:49:31.205ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48332025-06-04T04:49:31.207ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48342025-06-04T04:49:31.207ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 312.540403ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
48352025-06-04T04:49:31.221ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
48362025-06-04T04:49:31.221ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 325.511881ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
48372025-06-04T04:49:31.221ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48382025-06-04T04:49:31.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48392025-06-04T04:49:31.224ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 328.666138ms iteration = 27 status = null
48402025-06-04T04:49:31.240ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
48412025-06-04T04:49:31.253ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48422025-06-04T04:49:31.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48432025-06-04T04:49:31.255ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48442025-06-04T04:49:31.257ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48452025-06-04T04:49:31.257ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48462025-06-04T04:49:31.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48472025-06-04T04:49:31.269ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 374.724558ms iteration = 27 status = {}
48482025-06-04T04:49:31.292ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48492025-06-04T04:49:31.294ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48502025-06-04T04:49:31.294ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48512025-06-04T04:49:31.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48522025-06-04T04:49:31.339ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
48532025-06-04T04:49:31.340ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "402111ed-99ea-4ee8-8103-12e6f88cc2ac", "date": "Wed, 04 Jun 2025 04:49:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
48542025-06-04T04:49:31.340ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
48552025-06-04T04:49:31.341ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "65a6bcb0-b818-4144-a7b0-4b74c6d36860", "date": "Wed, 04 Jun 2025 04:49:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
48562025-06-04T04:49:31.341ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
48572025-06-04T04:49:31.343ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "82c88278-1bb2-48de-8c26-119fdd287d2d", "date": "Wed, 04 Jun 2025 04:49:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
48582025-06-04T04:49:31.343ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
48592025-06-04T04:49:31.345ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
48602025-06-04T04:49:31.345ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 450.363825ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
48612025-06-04T04:49:31.379ZINFOnexus (BackgroundTasks): VPC route manager sled cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
48622025-06-04T04:49:31.379ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48632025-06-04T04:49:31.379ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b589e518-0ae0-49e7-81a9-de31380d06f5", "content-length": "372", "date": "Wed, 04 Jun 2025 04:49:31 GMT"} })
48642025-06-04T04:49:31.379ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48652025-06-04T04:49:31.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48662025-06-04T04:49:31.393ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
48672025-06-04T04:49:31.393ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
48682025-06-04T04:49:31.395ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "46b5ae8e-0d7a-460e-a07b-e4472246fe95", "date": "Wed, 04 Jun 2025 04:49:31 GMT"} })
48692025-06-04T04:49:31.395ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48702025-06-04T04:49:31.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48712025-06-04T04:49:31.398ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48722025-06-04T04:49:31.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48732025-06-04T04:49:31.401ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48742025-06-04T04:49:31.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48752025-06-04T04:49:31.428ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
48762025-06-04T04:49:31.429ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0cc07e66-1539-4091-8d92-32ec7866e7d4", "content-length": "691", "date": "Wed, 04 Jun 2025 04:49:31 GMT"} })
48772025-06-04T04:49:31.429ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
48782025-06-04T04:49:31.429ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
48792025-06-04T04:49:31.429ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
48802025-06-04T04:49:31.430ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 534.663195ms iteration = 28 status = {}
48812025-06-04T04:49:31.431ZINFOnexus (BackgroundTasks): VPC route manager sled cb8aa4e2-773a-4f3e-86b7-f32104e9c4de push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
48822025-06-04T04:49:31.431ZDEBGnexus (BackgroundTasks): client request SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48832025-06-04T04:49:31.432ZDEBGnexus (BackgroundTasks): client response SledAgent = cb8aa4e2-773a-4f3e-86b7-f32104e9c4de background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c9e36f47-90cc-4f84-a99f-5c07f5e90ce4", "date": "Wed, 04 Jun 2025 04:49:31 GMT"} })
48842025-06-04T04:49:31.434ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 538.584715ms iteration = 28 status = {}
48852025-06-04T04:49:31.462ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48862025-06-04T04:49:31.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48872025-06-04T04:49:31.465ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: a0769b7e-afb1-46f8-b225-eac4dddfaf8d, rack_id: 5a147cfa-15ac-4bf0-8777-c82b354c8c36, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(913c54af-e122-4277-b509-f8a495f24eae) } rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch_location = Switch0
48882025-06-04T04:49:31.465ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48892025-06-04T04:49:31.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48902025-06-04T04:49:31.477ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
48912025-06-04T04:49:31.477ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 913c54af-e122-4277-b509-f8a495f24eae
48922025-06-04T04:49:31.477ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
48932025-06-04T04:49:31.477ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
48942025-06-04T04:49:31.477ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48952025-06-04T04:49:31.477ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48962025-06-04T04:49:31.477ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48972025-06-04T04:49:31.477ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48982025-06-04T04:49:31.477ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48992025-06-04T04:49:31.477ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49002025-06-04T04:49:31.478ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36
49012025-06-04T04:49:31.478ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49022025-06-04T04:49:31.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49032025-06-04T04:49:31.480ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch_location = Switch0
49042025-06-04T04:49:31.480ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
49052025-06-04T04:49:31.574ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9eab96fc-024a-4121-8b56-aaf175b65476", "date": "Wed, 04 Jun 2025 04:49:31 GMT"} })
49062025-06-04T04:49:31.574ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 switch = Switch0
49072025-06-04T04:49:31.574ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
49082025-06-04T04:49:31.574ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5a147cfa-15ac-4bf0-8777-c82b354c8c36 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d6aa63b-1050-4904-ab87-dfae132e0506", "content-length": "682", "date": "Wed, 04 Jun 2025 04:49:31 GMT"} })
49092025-06-04T04:49:31.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49102025-06-04T04:49:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49112025-06-04T04:49:31.578ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49122025-06-04T04:49:31.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49132025-06-04T04:49:31.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49142025-06-04T04:49:31.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49152025-06-04T04:49:31.584ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49162025-06-04T04:49:31.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49172025-06-04T04:49:31.591ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 695.863311ms iteration = 27 status = {}
49182025-06-04T04:49:31.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = a6c732bf-0d69-4fc9-9533-a441c5f2543e roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49192025-06-04T04:49:31.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = a6c732bf-0d69-4fc9-9533-a441c5f2543e resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49202025-06-04T04:49:31.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = a6c732bf-0d69-4fc9-9533-a441c5f2543e response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49212025-06-04T04:49:32.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = e96ad816-7e47-4453-831b-e50209887d58 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49222025-06-04T04:49:32.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = e96ad816-7e47-4453-831b-e50209887d58 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49232025-06-04T04:49:32.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2194 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = e96ad816-7e47-4453-831b-e50209887d58 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49242025-06-04T04:49:33.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = bdce49d6-9c90-4085-bebb-063c9da884ba roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49252025-06-04T04:49:33.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = bdce49d6-9c90-4085-bebb-063c9da884ba resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49262025-06-04T04:49:33.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2484 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = bdce49d6-9c90-4085-bebb-063c9da884ba response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49272025-06-04T04:49:34.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f6fd5d95-65bc-4be6-b968-1c19ae6508a7 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49282025-06-04T04:49:34.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f6fd5d95-65bc-4be6-b968-1c19ae6508a7 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49292025-06-04T04:49:34.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2752 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = f6fd5d95-65bc-4be6-b968-1c19ae6508a7 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49302025-06-04T04:49:35.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = e5b4ea6c-a860-4a09-904a-8c4cca1abd33 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49312025-06-04T04:49:35.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = e5b4ea6c-a860-4a09-904a-8c4cca1abd33 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49322025-06-04T04:49:35.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2453 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = e5b4ea6c-a860-4a09-904a-8c4cca1abd33 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49332025-06-04T04:49:36.506ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 716 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = 77c99167-6916-4ff3-aaac-29c8f7cbb685 response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
49342025-06-04T04:49:36.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = fcd14187-d8a9-49ba-9934-aabf82203e4b roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49352025-06-04T04:49:36.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = fcd14187-d8a9-49ba-9934-aabf82203e4b resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49362025-06-04T04:49:36.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2477 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = fcd14187-d8a9-49ba-9934-aabf82203e4b response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49372025-06-04T04:49:37.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c640f7df-1b02-4600-9bd5-4cab9f0255ac roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49382025-06-04T04:49:37.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c640f7df-1b02-4600-9bd5-4cab9f0255ac resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49392025-06-04T04:49:37.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1950 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c640f7df-1b02-4600-9bd5-4cab9f0255ac response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49402025-06-04T04:49:38.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2f8aafc0-2104-41c1-aeaf-f3d56fdc449c roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49412025-06-04T04:49:38.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2f8aafc0-2104-41c1-aeaf-f3d56fdc449c resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49422025-06-04T04:49:38.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2774 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 2f8aafc0-2104-41c1-aeaf-f3d56fdc449c response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49432025-06-04T04:49:39.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = aaa04618-cb6e-48ac-8b1b-39edf37ca140 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49442025-06-04T04:49:39.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = aaa04618-cb6e-48ac-8b1b-39edf37ca140 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49452025-06-04T04:49:39.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2498 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = aaa04618-cb6e-48ac-8b1b-39edf37ca140 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49462025-06-04T04:49:40.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 48751890-0967-48fa-903f-8cc35025865f roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49472025-06-04T04:49:40.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 48751890-0967-48fa-903f-8cc35025865f resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49482025-06-04T04:49:40.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2117 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 48751890-0967-48fa-903f-8cc35025865f response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49492025-06-04T04:49:40.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
49502025-06-04T04:49:40.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
49512025-06-04T04:49:40.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49522025-06-04T04:49:40.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49532025-06-04T04:49:40.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49542025-06-04T04:49:40.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49552025-06-04T04:49:40.897ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49562025-06-04T04:49:40.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49572025-06-04T04:49:40.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49582025-06-04T04:49:40.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49592025-06-04T04:49:40.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49602025-06-04T04:49:40.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49612025-06-04T04:49:40.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49622025-06-04T04:49:40.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49632025-06-04T04:49:40.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49642025-06-04T04:49:40.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1dd88a28-32c4-4490-89f2-ae05402d904c, lookup_type: ById(1dd88a28-32c4-4490-89f2-ae05402d904c) } result = Ok(())
49652025-06-04T04:49:40.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49662025-06-04T04:49:40.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49672025-06-04T04:49:40.918ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c original_time_created = 2025-06-04 04:36:14.609521 UTC target_id = 1dd88a28-32c4-4490-89f2-ae05402d904c time_created = 2025-06-04 04:36:14.609521 UTC
49682025-06-04T04:49:40.918ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.515642ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1dd88a28-32c4-4490-89f2-ae05402d904c","time_created":"2025-06-04T04:36:14.609521Z"}
49692025-06-04T04:49:40.930ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.811059ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49702025-06-04T04:49:41.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 40d3f44c-8d56-4dcb-9055-e9cf4ec36e9a roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49712025-06-04T04:49:41.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 40d3f44c-8d56-4dcb-9055-e9cf4ec36e9a resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49722025-06-04T04:49:41.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1843 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 40d3f44c-8d56-4dcb-9055-e9cf4ec36e9a response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49732025-06-04T04:49:42.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 105a86a0-6603-44b6-9c82-5e05cd88c15d roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49742025-06-04T04:49:42.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 105a86a0-6603-44b6-9c82-5e05cd88c15d resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49752025-06-04T04:49:42.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2017 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 105a86a0-6603-44b6-9c82-5e05cd88c15d response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49762025-06-04T04:49:43.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 59c12a7b-b3a6-4a4d-a575-b3b60b3437da roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49772025-06-04T04:49:43.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 59c12a7b-b3a6-4a4d-a575-b3b60b3437da resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49782025-06-04T04:49:43.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 59c12a7b-b3a6-4a4d-a575-b3b60b3437da response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49792025-06-04T04:49:44.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 60885f62-fc95-4365-8d76-fee2a99e2c96 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49802025-06-04T04:49:44.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 60885f62-fc95-4365-8d76-fee2a99e2c96 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49812025-06-04T04:49:44.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 60885f62-fc95-4365-8d76-fee2a99e2c96 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49822025-06-04T04:49:45.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5ef0ea15-5cf7-48cf-909a-a1e2f0acaabe roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49832025-06-04T04:49:45.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5ef0ea15-5cf7-48cf-909a-a1e2f0acaabe resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49842025-06-04T04:49:45.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2500 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 5ef0ea15-5cf7-48cf-909a-a1e2f0acaabe response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49852025-06-04T04:49:46.506ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 667 local_addr = [fd00:1122:3344:101::b]:49048 method = GET remote_addr = [fd00:1122:3344:101::d]:37097 req_id = 23f18e70-aea5-4b3f-9935-fd4ebe3e7d8c response_code = 200 uri = /88f0624a-d154-4dd4-8e91-901bdcc509e0
49862025-06-04T04:49:46.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 515cbe48-0056-41b0-b8b0-0f6228b98027 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49872025-06-04T04:49:46.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 515cbe48-0056-41b0-b8b0-0f6228b98027 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49882025-06-04T04:49:46.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1929 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 515cbe48-0056-41b0-b8b0-0f6228b98027 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49892025-06-04T04:49:47.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 07f44b5e-ce02-4a3c-ad59-2e981cb65c55 roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49902025-06-04T04:49:47.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 07f44b5e-ce02-4a3c-ad59-2e981cb65c55 resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49912025-06-04T04:49:47.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2343 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = 07f44b5e-ce02-4a3c-ad59-2e981cb65c55 response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49922025-06-04T04:49:48.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = ca8f1367-0806-443e-a480-75a07eb9cefd roles = RoleSet { roles: {} } uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49932025-06-04T04:49:48.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = ca8f1367-0806-443e-a480-75a07eb9cefd resource = Database result = Ok(()) uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de
49942025-06-04T04:49:48.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2620 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = ca8f1367-0806-443e-a480-75a07eb9cefd response_code = 200 uri = /probes/cb8aa4e2-773a-4f3e-86b7-f32104e9c4de