Max level shown:
12025-08-28T21:45:02.310ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 292a610c-703c-4829-b094-6a126fb328cb roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
22025-08-28T21:45:02.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 292a610c-703c-4829-b094-6a126fb328cb resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
32025-08-28T21:45:02.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 3137 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 292a610c-703c-4829-b094-6a126fb328cb response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
42025-08-28T21:45:02.404ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 0504395d-21fd-4484-beae-6d858dd3d13b remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6915f705-9d82-4389-be20-9b0b38837358 uri = /vmms/0504395d-21fd-4484-beae-6d858dd3d13b user_builtin_id = 001de000-05e4-4000-8000-000000000002 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-08-28T21:44:59.651106919Z }
52025-08-28T21:45:02.404ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6915f705-9d82-4389-be20-9b0b38837358 roles = RoleSet { roles: {} } uri = /vmms/0504395d-21fd-4484-beae-6d858dd3d13b user_builtin_id = 001de000-05e4-4000-8000-000000000002
62025-08-28T21:45:02.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6915f705-9d82-4389-be20-9b0b38837358 resource = Database result = Ok(()) uri = /vmms/0504395d-21fd-4484-beae-6d858dd3d13b user_builtin_id = 001de000-05e4-4000-8000-000000000002
72025-08-28T21:45:02.413ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 0504395d-21fd-4484-beae-6d858dd3d13b remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6915f705-9d82-4389-be20-9b0b38837358 uri = /vmms/0504395d-21fd-4484-beae-6d858dd3d13b user_builtin_id = 001de000-05e4-4000-8000-000000000002 vmm_needs_update = true
82025-08-28T21:45:02.413ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6915f705-9d82-4389-be20-9b0b38837358 roles = RoleSet { roles: {} } uri = /vmms/0504395d-21fd-4484-beae-6d858dd3d13b user_builtin_id = 001de000-05e4-4000-8000-000000000002
92025-08-28T21:45:02.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6915f705-9d82-4389-be20-9b0b38837358 resource = Database result = Ok(()) uri = /vmms/0504395d-21fd-4484-beae-6d858dd3d13b user_builtin_id = 001de000-05e4-4000-8000-000000000002
102025-08-28T21:45:02.418ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6915f705-9d82-4389-be20-9b0b38837358 roles = RoleSet { roles: {} } uri = /vmms/0504395d-21fd-4484-beae-6d858dd3d13b user_builtin_id = 001de000-05e4-4000-8000-000000000002
112025-08-28T21:45:02.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6915f705-9d82-4389-be20-9b0b38837358 resource = Database result = Ok(()) uri = /vmms/0504395d-21fd-4484-beae-6d858dd3d13b user_builtin_id = 001de000-05e4-4000-8000-000000000002
122025-08-28T21:45:02.420ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6915f705-9d82-4389-be20-9b0b38837358 roles = RoleSet { roles: {} } uri = /vmms/0504395d-21fd-4484-beae-6d858dd3d13b user_builtin_id = 001de000-05e4-4000-8000-000000000002
132025-08-28T21:45:02.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6915f705-9d82-4389-be20-9b0b38837358 resource = Database result = Ok(()) uri = /vmms/0504395d-21fd-4484-beae-6d858dd3d13b user_builtin_id = 001de000-05e4-4000-8000-000000000002
142025-08-28T21:45:02.422ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6915f705-9d82-4389-be20-9b0b38837358 roles = RoleSet { roles: {} } uri = /vmms/0504395d-21fd-4484-beae-6d858dd3d13b user_builtin_id = 001de000-05e4-4000-8000-000000000002
152025-08-28T21:45:02.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6915f705-9d82-4389-be20-9b0b38837358 resource = Database result = Ok(()) uri = /vmms/0504395d-21fd-4484-beae-6d858dd3d13b user_builtin_id = 001de000-05e4-4000-8000-000000000002
162025-08-28T21:45:02.424ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6915f705-9d82-4389-be20-9b0b38837358 roles = RoleSet { roles: {} } uri = /vmms/0504395d-21fd-4484-beae-6d858dd3d13b user_builtin_id = 001de000-05e4-4000-8000-000000000002
172025-08-28T21:45:02.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6915f705-9d82-4389-be20-9b0b38837358 resource = Database result = Ok(()) uri = /vmms/0504395d-21fd-4484-beae-6d858dd3d13b user_builtin_id = 001de000-05e4-4000-8000-000000000002
182025-08-28T21:45:02.426ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6915f705-9d82-4389-be20-9b0b38837358 roles = RoleSet { roles: {} } uri = /vmms/0504395d-21fd-4484-beae-6d858dd3d13b user_builtin_id = 001de000-05e4-4000-8000-000000000002
192025-08-28T21:45:02.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6915f705-9d82-4389-be20-9b0b38837358 resource = Database result = Ok(()) uri = /vmms/0504395d-21fd-4484-beae-6d858dd3d13b user_builtin_id = 001de000-05e4-4000-8000-000000000002
202025-08-28T21:45:02.428ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6915f705-9d82-4389-be20-9b0b38837358 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/0504395d-21fd-4484-beae-6d858dd3d13b user_builtin_id = 001de000-05e4-4000-8000-000000000002
212025-08-28T21:45:02.432ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6915f705-9d82-4389-be20-9b0b38837358 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: 9a9c1a75-9cd1-4e13-a807-276e1ce5e24f, lookup_type: ById(9a9c1a75-9cd1-4e13-a807-276e1ce5e24f) }, key: bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7, lookup_type: ById(bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7) } result = Ok(()) uri = /vmms/0504395d-21fd-4484-beae-6d858dd3d13b user_builtin_id = 001de000-05e4-4000-8000-000000000002
222025-08-28T21:45:02.432ZINFOnexus (dropshot_internal): starting update saga for bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 authenticated = true file = nexus/src/app/instance.rs:1603 instance_id = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6915f705-9d82-4389-be20-9b0b38837358 uri = /vmms/0504395d-21fd-4484-beae-6d858dd3d13b user_builtin_id = 001de000-05e4-4000-8000-000000000002 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-08-28T21:44:59.651106919Z }
232025-08-28T21:45:02.432ZDEBGnexus (dropshot_internal): preparing instance-update saga for bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7... authenticated = true instance_id = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6915f705-9d82-4389-be20-9b0b38837358 uri = /vmms/0504395d-21fd-4484-beae-6d858dd3d13b user_builtin_id = 001de000-05e4-4000-8000-000000000002
242025-08-28T21:45:02.432ZINFOnexus (SagaQuiesceHandle): tracking newly created saga file = nexus/types/src/quiesce.rs:374 saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066
252025-08-28T21:45:02.432ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:283 saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update
262025-08-28T21:45:02.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 27737 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6915f705-9d82-4389-be20-9b0b38837358 response_code = 204 uri = /vmms/0504395d-21fd-4484-beae-6d858dd3d13b
272025-08-28T21:45:02.432ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7","lookup_type":{"ById":"bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7"},"parent":{"key":"9a9c1a75-9cd1-4e13-a807-276e1ce5e24f","lookup_type":{"ById":"9a9c1a75-9cd1-4e13-a807-276e1ce5e24f"},"parent":{"key":"427aaf87-3d8a-4dc0-888f-bfc71eaeae3f","lookup_type":{"ById":"427aaf87-3d8a-4dc0-888f-bfc71eaeae3f"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
282025-08-28T21:45:02.432ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update
292025-08-28T21:45:02.436ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:383 saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update
302025-08-28T21:45:02.436ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
312025-08-28T21:45:02.436ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
322025-08-28T21:45:02.436ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066
332025-08-28T21:45:02.439ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
342025-08-28T21:45:02.439ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
352025-08-28T21:45:02.441ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
362025-08-28T21:45:02.441ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066
372025-08-28T21:45:02.441ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
382025-08-28T21:45:02.442ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
392025-08-28T21:45:02.443ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
402025-08-28T21:45:02.445ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = ConsoleSession { parent: Fleet, key: 81a01eda-ac4b-404c-98bb-3e70c031d0d6 (console_session), lookup_type: ById(81a01eda-ac4b-404c-98bb-3e70c031d0d6) } result = Ok(())
412025-08-28T21:45:02.445ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
422025-08-28T21:45:02.445ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
432025-08-28T21:45:02.445ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066
442025-08-28T21:45:02.445ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
452025-08-28T21:45:02.446ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 140 reason = Timeout
462025-08-28T21:45:02.446ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
472025-08-28T21:45:02.446ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
482025-08-28T21:45:02.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
492025-08-28T21:45:02.447ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
502025-08-28T21:45:02.448ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
512025-08-28T21:45:02.448ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
522025-08-28T21:45:02.448ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
532025-08-28T21:45:02.449ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
542025-08-28T21:45:02.449ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("dbe1e18b-37e6-4f42-8463-5bc81bc9da9a")) node_id = 0 saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066
552025-08-28T21:45:02.450ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
562025-08-28T21:45:02.450ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
572025-08-28T21:45:02.451ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
582025-08-28T21:45:02.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
592025-08-28T21:45:02.451ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
602025-08-28T21:45:02.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
612025-08-28T21:45:02.452ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
622025-08-28T21:45:02.452ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066
632025-08-28T21:45:02.453ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), lookup_type: ById(d39666d5-c52f-4734-9b61-e44c37604a64) } result = Ok(())
642025-08-28T21:45:02.453ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
652025-08-28T21:45:02.453ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
662025-08-28T21:45:02.453ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
672025-08-28T21:45:02.453ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.32455ms iteration = 140 status = {"chicken_switches_updated":false}
682025-08-28T21:45:02.454ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
692025-08-28T21:45:02.455ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update
702025-08-28T21:45:02.455ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = LockInstance user_builtin_id = 001de000-05e4-4000-8000-000000000002
712025-08-28T21:45:02.456ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = ConsoleSession { parent: Fleet, key: 81a01eda-ac4b-404c-98bb-3e70c031d0d6 (console_session), lookup_type: ById(81a01eda-ac4b-404c-98bb-3e70c031d0d6) } result = Ok(())
722025-08-28T21:45:02.456ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = LockInstance user_builtin_id = 001de000-05e4-4000-8000-000000000002
732025-08-28T21:45:02.456ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
742025-08-28T21:45:02.456ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
752025-08-28T21:45:02.458ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = LockInstance user_builtin_id = 001de000-05e4-4000-8000-000000000002
762025-08-28T21:45:02.458ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = LockInstance user_builtin_id = 001de000-05e4-4000-8000-000000000002
772025-08-28T21:45:02.459ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = LockInstance user_builtin_id = 001de000-05e4-4000-8000-000000000002
782025-08-28T21:45:02.459ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = LockInstance user_builtin_id = 001de000-05e4-4000-8000-000000000002
792025-08-28T21:45:02.460ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
802025-08-28T21:45:02.460ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
812025-08-28T21:45:02.461ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = LockInstance user_builtin_id = 001de000-05e4-4000-8000-000000000002
822025-08-28T21:45:02.461ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
832025-08-28T21:45:02.461ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = LockInstance user_builtin_id = 001de000-05e4-4000-8000-000000000002
842025-08-28T21:45:02.461ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
852025-08-28T21:45:02.462ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
862025-08-28T21:45:02.462ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
872025-08-28T21:45:02.463ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = LockInstance user_builtin_id = 001de000-05e4-4000-8000-000000000002
882025-08-28T21:45:02.463ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = LockInstance user_builtin_id = 001de000-05e4-4000-8000-000000000002
892025-08-28T21:45:02.464ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
902025-08-28T21:45:02.464ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
912025-08-28T21:45:02.464ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = LockInstance user_builtin_id = 001de000-05e4-4000-8000-000000000002
922025-08-28T21:45:02.464ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = LockInstance user_builtin_id = 001de000-05e4-4000-8000-000000000002
932025-08-28T21:45:02.466ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
942025-08-28T21:45:02.466ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = LockInstance user_builtin_id = 001de000-05e4-4000-8000-000000000002
952025-08-28T21:45:02.467ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), lookup_type: ById(d39666d5-c52f-4734-9b61-e44c37604a64) } result = Ok(())
962025-08-28T21:45:02.467ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
972025-08-28T21:45:02.468ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
982025-08-28T21:45:02.469ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
992025-08-28T21:45:02.469ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
1002025-08-28T21:45:02.470ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: 9a9c1a75-9cd1-4e13-a807-276e1ce5e24f, lookup_type: ById(9a9c1a75-9cd1-4e13-a807-276e1ce5e24f) }, key: bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7, lookup_type: ById(bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7) } result = Ok(()) saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = LockInstance user_builtin_id = 001de000-05e4-4000-8000-000000000002
1012025-08-28T21:45:02.470ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock authenticated = true current_gen = Generation(Generation(1)) instance_id = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = LockInstance updater_id = dbe1e18b-37e6-4f42-8463-5bc81bc9da9a user_builtin_id = 001de000-05e4-4000-8000-000000000002
1022025-08-28T21:45:02.470ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = LockInstance user_builtin_id = 001de000-05e4-4000-8000-000000000002
1032025-08-28T21:45:02.470ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = LockInstance user_builtin_id = 001de000-05e4-4000-8000-000000000002
1042025-08-28T21:45:02.470ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1052025-08-28T21:45:02.470ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
1062025-08-28T21:45:02.472ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
1072025-08-28T21:45:02.473ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) } result = Ok(())
1082025-08-28T21:45:02.473ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1092025-08-28T21:45:02.473ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1102025-08-28T21:45:02.476ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1112025-08-28T21:45:02.476ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1122025-08-28T21:45:02.478ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 roles = RoleSet { roles: {(Silo, 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, "admin")} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1132025-08-28T21:45:02.479ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 resource = AuditLog result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1142025-08-28T21:45:02.479ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1152025-08-28T21:45:02.479ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1162025-08-28T21:45:02.481ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock authenticated = true current_gen = Generation(Generation(1)) instance_id = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = LockInstance updater_id = dbe1e18b-37e6-4f42-8463-5bc81bc9da9a user_builtin_id = 001de000-05e4-4000-8000-000000000002
1172025-08-28T21:45:02.481ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = LockInstance user_builtin_id = 001de000-05e4-4000-8000-000000000002
1182025-08-28T21:45:02.482ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = LockInstance user_builtin_id = 001de000-05e4-4000-8000-000000000002
1192025-08-28T21:45:02.483ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1202025-08-28T21:45:02.483ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1212025-08-28T21:45:02.485ZDEBGnexus (SagaExecutor): instance updater lock acquired! already_locked = true authenticated = true instance_id = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 locked_gen = Generation(Generation(2)) saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = LockInstance updater_id = dbe1e18b-37e6-4f42-8463-5bc81bc9da9a user_builtin_id = 001de000-05e4-4000-8000-000000000002
1222025-08-28T21:45:02.485ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
1232025-08-28T21:45:02.485ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("dbe1e18b-37e6-4f42-8463-5bc81bc9da9a")}) node_id = 1 saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066
1242025-08-28T21:45:02.485ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1252025-08-28T21:45:02.485ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1262025-08-28T21:45:02.486ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1272025-08-28T21:45:02.487ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1282025-08-28T21:45:02.489ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1292025-08-28T21:45:02.489ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
1302025-08-28T21:45:02.489ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066
1312025-08-28T21:45:02.489ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1322025-08-28T21:45:02.491ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1332025-08-28T21:45:02.491ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1342025-08-28T21:45:02.492ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga user_builtin_id = 001de000-05e4-4000-8000-000000000002
1352025-08-28T21:45:02.492ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga user_builtin_id = 001de000-05e4-4000-8000-000000000002
1362025-08-28T21:45:02.494ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1372025-08-28T21:45:02.494ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1382025-08-28T21:45:02.496ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga user_builtin_id = 001de000-05e4-4000-8000-000000000002
1392025-08-28T21:45:02.496ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga user_builtin_id = 001de000-05e4-4000-8000-000000000002
1402025-08-28T21:45:02.497ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1412025-08-28T21:45:02.497ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1422025-08-28T21:45:02.497ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga user_builtin_id = 001de000-05e4-4000-8000-000000000002
1432025-08-28T21:45:02.497ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga user_builtin_id = 001de000-05e4-4000-8000-000000000002
1442025-08-28T21:45:02.499ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga user_builtin_id = 001de000-05e4-4000-8000-000000000002
1452025-08-28T21:45:02.499ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 roles = RoleSet { roles: {(Silo, 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, "admin")} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1462025-08-28T21:45:02.503ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: 9a9c1a75-9cd1-4e13-a807-276e1ce5e24f, lookup_type: ById(9a9c1a75-9cd1-4e13-a807-276e1ce5e24f) }, key: bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7, lookup_type: ById(bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7) } result = Ok(()) saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga user_builtin_id = 001de000-05e4-4000-8000-000000000002
1472025-08-28T21:45:02.503ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga user_builtin_id = 001de000-05e4-4000-8000-000000000002
1482025-08-28T21:45:02.503ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: 9a9c1a75-9cd1-4e13-a807-276e1ce5e24f, lookup_type: ByName("proj-e359e85c650") }, key: bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7, lookup_type: ByName("instance-3b99e99a5c1") } result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1492025-08-28T21:45:02.503ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1502025-08-28T21:45:02.503ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga user_builtin_id = 001de000-05e4-4000-8000-000000000002
1512025-08-28T21:45:02.503ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1522025-08-28T21:45:02.506ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1532025-08-28T21:45:02.506ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1542025-08-28T21:45:02.509ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1552025-08-28T21:45:02.509ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1562025-08-28T21:45:02.511ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1572025-08-28T21:45:02.511ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1582025-08-28T21:45:02.513ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 0504395d-21fd-4484-beae-6d858dd3d13b, time_created: 2025-08-28T21:44:41.526841Z, time_deleted: None, instance_id: bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7, sled_id: af8277ed-838c-4274-8629-14eae35fd0e4, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-08-28T21:44:59.651106Z, gen: Generation(Generation(7)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-08-28T21:44:39.046925Z, gen: Generation(Generation(3)), propolis_id: Some(0504395d-21fd-4484-beae-6d858dd3d13b), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(0504395d-21fd-4484-beae-6d858dd3d13b (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-08-28T21:45:02.513589367Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
1592025-08-28T21:45:02.513ZINFOnexus (SagaQuiesceHandle): tracking newly created saga file = nexus/types/src/quiesce.rs:374 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
1602025-08-28T21:45:02.513ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:283 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update
1612025-08-28T21:45:02.513ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"0504395d-21fd-4484-beae-6d858dd3d13b"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7","lookup_type":{"ById":"bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7"},"parent":{"key":"9a9c1a75-9cd1-4e13-a807-276e1ce5e24f","lookup_type":{"ById":"9a9c1a75-9cd1-4e13-a807-276e1ce5e24f"},"parent":{"key":"427aaf87-3d8a-4dc0-888f-bfc71eaeae3f","lookup_type":{"ById":"427aaf87-3d8a-4dc0-888f-bfc71eaeae3f"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"dbe1e18b-37e6-4f42-8463-5bc81bc9da9a"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"9a9c1a75-9cd1-4e13-a807-276e1ce5e24f","ram_diff":1073741824},"destroy_active_vmm":"0504395d-21fd-4484-beae-6d858dd3d13b","destroy_target_vmm":null,"network_config":"Delete","new_intent":null,"new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-08-28T21:45:02.513589367Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
1622025-08-28T21:45:02.513ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update
1632025-08-28T21:45:02.513ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 roles = RoleSet { roles: {(Silo, 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, "admin")} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1642025-08-28T21:45:02.517ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: 9a9c1a75-9cd1-4e13-a807-276e1ce5e24f, lookup_type: ByName("proj-e359e85c650") }, key: bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7, lookup_type: ByName("instance-3b99e99a5c1") } result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1652025-08-28T21:45:02.520ZINFOnexus (dropshot_external): set intended instance state authenticated = true changed = false file = nexus/db-queries/src/db/datastore/instance.rs:812 instance_id = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 intended_state = destroyed local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
1662025-08-28T21:45:02.520ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
1672025-08-28T21:45:02.520ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
1682025-08-28T21:45:02.521ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
1692025-08-28T21:45:02.523ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Fleet result = Ok(())
1702025-08-28T21:45:02.523ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
1712025-08-28T21:45:02.523ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
1722025-08-28T21:45:02.525ZINFOnexus (SagaQuiesceHandle): tracking newly created saga file = nexus/types/src/quiesce.rs:374 saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd
1732025-08-28T21:45:02.525ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:283 saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete
1742025-08-28T21:45:02.525ZINFOnexus (SEC): saga create dag = {"end_node":5,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,0,null],[3,5,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"instance_delete.instance_delete_nat","label":"InstanceDeleteNat","name":"no_result4"}},{"Action":{"action_name":"instance_delete.instance_delete_record","label":"InstanceDeleteRecord","name":"no_result1"}},{"Action":{"action_name":"instance_delete.delete_network_interfaces","label":"DeleteNetworkInterfaces","name":"no_result2"}},{"Action":{"action_name":"instance_delete.deallocate_external_ip","label":"DeallocateExternalIp","name":"no_result3"}},{"Start":{"params":{"authz_instance":{"key":"bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7","lookup_type":{"ByName":"instance-3b99e99a5c1"},"parent":{"key":"9a9c1a75-9cd1-4e13-a807-276e1ce5e24f","lookup_type":{"ByName":"proj-e359e85c650"},"parent":{"key":"427aaf87-3d8a-4dc0-888f-bfc71eaeae3f","lookup_type":{"ById":"427aaf87-3d8a-4dc0-888f-bfc71eaeae3f"},"parent":null}}},"boundary_switches":["switch0"],"instance":{"auto_restart":{"cooldown":null,"policy":null},"boot_disk_id":"6be0decb-489b-4176-b68f-bb4368fca0be","hostname":"localshark","identity":{"description":"","id":"bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7","name":"instance-3b99e99a5c1","time_created":"2025-08-28T21:44:39.046925Z","time_deleted":null,"time_modified":"2025-08-28T21:44:59.735377Z"},"intended_state":"Destroyed","memory":1073741824,"ncpus":2,"project_id":"9a9c1a75-9cd1-4e13-a807-276e1ce5e24f","runtime_state":{"dst_propolis_id":null,"gen":3,"migration_id":null,"nexus_state":"Vmm","propolis_id":"0504395d-21fd-4484-beae-6d858dd3d13b","time_last_auto_restarted":null,"time_updated":"2025-08-28T21:44:39.046925Z"},"updater_gen":2,"updater_id":"dbe1e18b-37e6-4f42-8463-5bc81bc9da9a","user_data":[]},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"427aaf87-3d8a-4dc0-888f-bfc71eaeae3f","silo_user_id":"d39666d5-c52f-4734-9b61-e44c37604a64"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"instance-delete","start_node":4} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
1752025-08-28T21:45:02.525ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete
1762025-08-28T21:45:02.528ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:383 saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete
1772025-08-28T21:45:02.528ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
1782025-08-28T21:45:02.528ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
1792025-08-28T21:45:02.528ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd
1802025-08-28T21:45:02.532ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
1812025-08-28T21:45:02.532ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd
1822025-08-28T21:45:02.536ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
1832025-08-28T21:45:02.536ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd
1842025-08-28T21:45:02.539ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
1852025-08-28T21:45:02.539ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
1862025-08-28T21:45:02.541ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
1872025-08-28T21:45:02.541ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
1882025-08-28T21:45:02.542ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
1892025-08-28T21:45:02.543ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
1902025-08-28T21:45:02.544ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
1912025-08-28T21:45:02.544ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
1922025-08-28T21:45:02.546ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
1932025-08-28T21:45:02.547ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
1942025-08-28T21:45:02.549ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
1952025-08-28T21:45:02.549ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
1962025-08-28T21:45:02.551ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
1972025-08-28T21:45:02.551ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
1982025-08-28T21:45:02.552ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:383 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update
1992025-08-28T21:45:02.552ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
2002025-08-28T21:45:02.552ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
2012025-08-28T21:45:02.552ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
2022025-08-28T21:45:02.554ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Silo, 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, "admin")} } saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
2032025-08-28T21:45:02.555ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
2042025-08-28T21:45:02.555ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
2052025-08-28T21:45:02.557ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: 9a9c1a75-9cd1-4e13-a807-276e1ce5e24f, lookup_type: ById(9a9c1a75-9cd1-4e13-a807-276e1ce5e24f) }, key: bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7, lookup_type: ById(bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7) } result = Ok(()) saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
2062025-08-28T21:45:02.557ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:545 instance_id = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7
2072025-08-28T21:45:02.557ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
2082025-08-28T21:45:02.557ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
2092025-08-28T21:45:02.559ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
2102025-08-28T21:45:02.559ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
2112025-08-28T21:45:02.560ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
2122025-08-28T21:45:02.560ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
2132025-08-28T21:45:02.562ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
2142025-08-28T21:45:02.562ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
2152025-08-28T21:45:02.562ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
2162025-08-28T21:45:02.564ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
2172025-08-28T21:45:02.564ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("a1cd6c1d-8861-48b5-8bc9-602b13021f44")) node_id = 0 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
2182025-08-28T21:45:02.564ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
2192025-08-28T21:45:02.564ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
2202025-08-28T21:45:02.564ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
2212025-08-28T21:45:02.566ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
2222025-08-28T21:45:02.567ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Fleet result = Ok(())
2232025-08-28T21:45:02.567ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
2242025-08-28T21:45:02.567ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
2252025-08-28T21:45:02.567ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
2262025-08-28T21:45:02.567ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
2272025-08-28T21:45:02.570ZDEBGnexus: notifying dendrite of updates instance_id = Some(bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 (instance)) switch = switch0
2282025-08-28T21:45:02.570ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1671, tv_nsec: 101965055 } })
2292025-08-28T21:45:02.571ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1205
2302025-08-28T21:45:02.573ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 parent_lock = UpdaterLock { updater_id: dbe1e18b-37e6-4f42-8463-5bc81bc9da9a, locked_gen: Generation(Generation(2)) } saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update
2312025-08-28T21:45:02.573ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = BecomeUpdater user_builtin_id = 001de000-05e4-4000-8000-000000000002
2322025-08-28T21:45:02.573ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = BecomeUpdater user_builtin_id = 001de000-05e4-4000-8000-000000000002
2332025-08-28T21:45:02.581ZDEBGnexus (SagaExecutor): inherited lock from dbe1e18b-37e6-4f42-8463-5bc81bc9da9a to a1cd6c1d-8861-48b5-8bc9-602b13021f44 authenticated = true instance_id = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = dbe1e18b-37e6-4f42-8463-5bc81bc9da9a saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = BecomeUpdater updater_id = a1cd6c1d-8861-48b5-8bc9-602b13021f44 user_builtin_id = 001de000-05e4-4000-8000-000000000002
2342025-08-28T21:45:02.581ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:987 instance_id = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update
2352025-08-28T21:45:02.581ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
2362025-08-28T21:45:02.581ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("a1cd6c1d-8861-48b5-8bc9-602b13021f44")}) node_id = 1 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
2372025-08-28T21:45:02.584ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
2382025-08-28T21:45:02.584ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
2392025-08-28T21:45:02.588ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
2402025-08-28T21:45:02.588ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
2412025-08-28T21:45:02.590ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
2422025-08-28T21:45:02.591ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
2432025-08-28T21:45:02.594ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1040 instance_id = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update
2442025-08-28T21:45:02.594ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:545 instance_id = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7
2452025-08-28T21:45:02.594ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = UpdateNetworkConfig user_builtin_id = 001de000-05e4-4000-8000-000000000002
2462025-08-28T21:45:02.594ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = UpdateNetworkConfig user_builtin_id = 001de000-05e4-4000-8000-000000000002
2472025-08-28T21:45:02.596ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = UpdateNetworkConfig user_builtin_id = 001de000-05e4-4000-8000-000000000002
2482025-08-28T21:45:02.597ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = UpdateNetworkConfig user_builtin_id = 001de000-05e4-4000-8000-000000000002
2492025-08-28T21:45:02.598ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
2502025-08-28T21:45:02.598ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = UpdateNetworkConfig user_builtin_id = 001de000-05e4-4000-8000-000000000002
2512025-08-28T21:45:02.599ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = UpdateNetworkConfig user_builtin_id = 001de000-05e4-4000-8000-000000000002
2522025-08-28T21:45:02.601ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
2532025-08-28T21:45:02.601ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
2542025-08-28T21:45:02.601ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
2552025-08-28T21:45:02.601ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1213 zone_address = fd00:1122:3344:101::2
2562025-08-28T21:45:02.601ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2572025-08-28T21:45:02.601ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d343d4c-9bfb-4c7b-904a-0f08aa079610", "content-length": "26", "date": "Thu, 28 Aug 2025 21:45:02 GMT"} })
2582025-08-28T21:45:02.601ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1216 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2592025-08-28T21:45:02.602ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
2602025-08-28T21:45:02.603ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1250 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2612025-08-28T21:45:02.603ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Fleet result = Ok(())
2622025-08-28T21:45:02.603ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
2632025-08-28T21:45:02.604ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
2642025-08-28T21:45:02.607ZDEBGnexus: notifying dendrite of updates instance_id = Some(bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 (instance)) switch = switch0
2652025-08-28T21:45:02.608ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1671, tv_nsec: 139742855 } })
2662025-08-28T21:45:02.608ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1205
2672025-08-28T21:45:02.658ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
2682025-08-28T21:45:02.658ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 0 saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd
2692025-08-28T21:45:02.661ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
2702025-08-28T21:45:02.661ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd
2712025-08-28T21:45:02.662ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1213 zone_address = fd00:1122:3344:101::2
2722025-08-28T21:45:02.662ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2732025-08-28T21:45:02.662ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "06412c18-5159-4e1b-be06-30351deda6e4", "content-length": "26", "date": "Thu, 28 Aug 2025 21:45:02 GMT"} })
2742025-08-28T21:45:02.662ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1216 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2752025-08-28T21:45:02.664ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1250 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2762025-08-28T21:45:02.665ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
2772025-08-28T21:45:02.665ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
2782025-08-28T21:45:02.667ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
2792025-08-28T21:45:02.668ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
2802025-08-28T21:45:02.670ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
2812025-08-28T21:45:02.671ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
2822025-08-28T21:45:02.673ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
2832025-08-28T21:45:02.673ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
2842025-08-28T21:45:02.675ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Silo, 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, "admin")} } saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
2852025-08-28T21:45:02.678ZDEBGnexus (SagaExecutor): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: 9a9c1a75-9cd1-4e13-a807-276e1ce5e24f, lookup_type: ByName("proj-e359e85c650") }, key: bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7, lookup_type: ByName("instance-3b99e99a5c1") } result = Ok(()) saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
2862025-08-28T21:45:02.678ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
2872025-08-28T21:45:02.678ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
2882025-08-28T21:45:02.697ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
2892025-08-28T21:45:02.697ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
2902025-08-28T21:45:02.702ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
2912025-08-28T21:45:02.702ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
2922025-08-28T21:45:02.704ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = ReleaseVirtualProvisioning user_builtin_id = 001de000-05e4-4000-8000-000000000002
2932025-08-28T21:45:02.705ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = ReleaseVirtualProvisioning user_builtin_id = 001de000-05e4-4000-8000-000000000002
2942025-08-28T21:45:02.751ZDEBGnexus (SEC): saga log event new_state = N001 failed sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
2952025-08-28T21:45:02.751ZDEBGnexus (SecStore): recording saga event event_type = Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }) node_id = 1 saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd
2962025-08-28T21:45:02.755ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Unwinding saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
2972025-08-28T21:45:02.755ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = unwinding saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd
2982025-08-28T21:45:02.760ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1115 instance_id = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-08-28T21:45:02.706028Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, time_modified: Some(2025-08-28T21:45:02.706028Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 9a9c1a75-9cd1-4e13-a807-276e1ce5e24f, time_modified: Some(2025-08-28T21:45:02.706028Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update
2992025-08-28T21:45:02.760ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
3002025-08-28T21:45:02.760ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
3012025-08-28T21:45:02.763ZDEBGnexus (SEC): saga log event new_state = N000 undo_started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
3022025-08-28T21:45:02.763ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 0 saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd
3032025-08-28T21:45:02.763ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
3042025-08-28T21:45:02.763ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
3052025-08-28T21:45:02.767ZDEBGnexus (SEC): saga log event new_state = N000 undo_finished sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
3062025-08-28T21:45:02.767ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 0 saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd
3072025-08-28T21:45:02.767ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1150 instance_id = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update
3082025-08-28T21:45:02.767ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = UnassignOximeterProducer user_builtin_id = 001de000-05e4-4000-8000-000000000002
3092025-08-28T21:45:02.768ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = UnassignOximeterProducer user_builtin_id = 001de000-05e4-4000-8000-000000000002
3102025-08-28T21:45:02.770ZDEBGnexus (SEC): saga log event new_state = N004 undo_started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
3112025-08-28T21:45:02.770ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 4 saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd
3122025-08-28T21:45:02.772ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = fbcc3716-f2fd-4c7d-a691-c299da81c53f producer_id = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update
3132025-08-28T21:45:02.772ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = UnassignOximeterProducer user_builtin_id = 001de000-05e4-4000-8000-000000000002
3142025-08-28T21:45:02.772ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = UnassignOximeterProducer user_builtin_id = 001de000-05e4-4000-8000-000000000002
3152025-08-28T21:45:02.774ZDEBGnexus (SEC): saga log event new_state = N004 undo_finished sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
3162025-08-28T21:45:02.774ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 4 saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd
3172025-08-28T21:45:02.781ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
3182025-08-28T21:45:02.781ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd
3192025-08-28T21:45:02.788ZWARNnexus (SEC): saga finished action_error_node_name = "no_result1" action_error_source = ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} } file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1044 result = failure saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete sec_id = 0fe4e55a-5967-4507-9554-6c41366055df undo_result = success
3202025-08-28T21:45:02.788ZINFOnexus (SagaQuiesceHandle): tracked saga has finished file = nexus/types/src/quiesce.rs:513 saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd
3212025-08-28T21:45:02.788ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:433 saga_id = 7e84bb8c-357d-4140-888a-f78d445835dd saga_name = instance-delete saga_result = SagaResult { saga_id: 7e84bb8c-357d-4140-888a-f78d445835dd, saga_log: SagaLog { saga_id: 7e84bb8c-357d-4140-888a-f78d445835dd, unwinding: true, events: [N004 started, N004 succeeded, N000 started, N000 succeeded, N001 started, N001 failed, N000 undo_started, N000 undo_finished, N004 undo_started, N004 undo_finished], node_status: {0: UndoFinished, 1: Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }), 4: UndoFinished} }, kind: Err(SagaResultErr { error_node_name: "no_result1", error_source: ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }, undo_failure: None }) }
3222025-08-28T21:45:02.788ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
3232025-08-28T21:45:02.788ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
3242025-08-28T21:45:02.791ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
3252025-08-28T21:45:02.791ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
3262025-08-28T21:45:02.793ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 roles = RoleSet { roles: {(Silo, 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, "admin")} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
3272025-08-28T21:45:02.794ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 resource = AuditLog result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
3282025-08-28T21:45:02.794ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
3292025-08-28T21:45:02.794ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
3302025-08-28T21:45:02.809ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update
3312025-08-28T21:45:02.809ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7
3322025-08-28T21:45:02.828ZDEBGnexus (SagaExecutor): client response oximeter-collector = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7", status: 204, headers: {"x-request-id": "128d5c2e-ec0c-40dd-b2c6-bf8d8d5d07b8", "date": "Thu, 28 Aug 2025 21:45:02 GMT"} }) saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update
3332025-08-28T21:45:02.828ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = fbcc3716-f2fd-4c7d-a691-c299da81c53f producer_id = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update
3342025-08-28T21:45:02.831ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
3352025-08-28T21:45:02.831ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
3362025-08-28T21:45:02.835ZINFOnexus (dropshot_external): request completed error_message_external = cannot delete instance: instance is running or has not yet fully stopped error_message_internal = cannot delete instance: instance is running or has not yet fully stopped (with internal context: saga ACTION error at node "no_result1") file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:855 latency_us = 395950 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 1e5d3222-ac41-4b58-b521-ee0de4562419 response_code = 400 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
3372025-08-28T21:45:02.837ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
3382025-08-28T21:45:02.837ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
3392025-08-28T21:45:02.840ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 lock = UpdaterLock { updater_id: a1cd6c1d-8861-48b5-8bc9-602b13021f44, locked_gen: Generation(Generation(3)) } new_intent = None new_runtime = InstanceRuntimeState { time_updated: 2025-08-28T21:45:02.513589367Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update
3402025-08-28T21:45:02.841ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = CommitInstanceUpdates user_builtin_id = 001de000-05e4-4000-8000-000000000002
3412025-08-28T21:45:02.841ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = CommitInstanceUpdates user_builtin_id = 001de000-05e4-4000-8000-000000000002
3422025-08-28T21:45:02.853ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1201 instance_id = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 new_runtime = InstanceRuntimeState { time_updated: 2025-08-28T21:45:02.513589367Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update
3432025-08-28T21:45:02.853ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
3442025-08-28T21:45:02.853ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3452025-08-28T21:45:02.853ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Signaled
3462025-08-28T21:45:02.853ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
3472025-08-28T21:45:02.853ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
3482025-08-28T21:45:02.853ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
3492025-08-28T21:45:02.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3502025-08-28T21:45:02.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
3512025-08-28T21:45:02.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3522025-08-28T21:45:02.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3532025-08-28T21:45:02.856ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
3542025-08-28T21:45:02.856ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
3552025-08-28T21:45:02.857ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
3562025-08-28T21:45:02.857ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3572025-08-28T21:45:02.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3582025-08-28T21:45:02.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3592025-08-28T21:45:02.860ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
3602025-08-28T21:45:02.860ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("0504395d-21fd-4484-beae-6d858dd3d13b")}) node_id = 7 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
3612025-08-28T21:45:02.861ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
3622025-08-28T21:45:02.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3632025-08-28T21:45:02.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3642025-08-28T21:45:02.863ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
3652025-08-28T21:45:02.863ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
3662025-08-28T21:45:02.864ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3672025-08-28T21:45:02.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
3682025-08-28T21:45:02.867ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
3692025-08-28T21:45:02.867ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
3702025-08-28T21:45:02.870ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
3712025-08-28T21:45:02.870ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
3722025-08-28T21:45:02.872ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3732025-08-28T21:45:02.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
3742025-08-28T21:45:02.873ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3752025-08-28T21:45:02.875ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3762025-08-28T21:45:02.875ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3772025-08-28T21:45:02.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
3782025-08-28T21:45:02.876ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:82 instance_id = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 propolis_id = 0504395d-21fd-4484-beae-6d858dd3d13b saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update
3792025-08-28T21:45:02.876ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = ReleaseSledResources user_builtin_id = 001de000-05e4-4000-8000-000000000002
3802025-08-28T21:45:02.876ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = ReleaseSledResources user_builtin_id = 001de000-05e4-4000-8000-000000000002
3812025-08-28T21:45:02.877ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3822025-08-28T21:45:02.879ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3832025-08-28T21:45:02.879ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3842025-08-28T21:45:02.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
3852025-08-28T21:45:02.889ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
3862025-08-28T21:45:02.889ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
3872025-08-28T21:45:02.892ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
3882025-08-28T21:45:02.892ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
3892025-08-28T21:45:02.895ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:113 instance_id = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 propolis_id = 0504395d-21fd-4484-beae-6d858dd3d13b saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update
3902025-08-28T21:45:02.895ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = MarkVmmDeleted user_builtin_id = 001de000-05e4-4000-8000-000000000002
3912025-08-28T21:45:02.896ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = MarkVmmDeleted user_builtin_id = 001de000-05e4-4000-8000-000000000002
3922025-08-28T21:45:02.904ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
3932025-08-28T21:45:02.904ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
3942025-08-28T21:45:02.910ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
3952025-08-28T21:45:02.910ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
3962025-08-28T21:45:02.914ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
3972025-08-28T21:45:02.914ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
3982025-08-28T21:45:02.915ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
3992025-08-28T21:45:02.915ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9396376-6930-4924-80ce-589faa6f6cd4", "content-length": "691", "date": "Thu, 28 Aug 2025 21:45:02 GMT"} })
4002025-08-28T21:45:02.916ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
4012025-08-28T21:45:02.916ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
4022025-08-28T21:45:02.916ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
4032025-08-28T21:45:02.917ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 64.145694ms iteration = 26 status = {}
4042025-08-28T21:45:02.917ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
4052025-08-28T21:45:02.917ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
4062025-08-28T21:45:02.920ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = ChainSuccessorSaga user_builtin_id = 001de000-05e4-4000-8000-000000000002
4072025-08-28T21:45:02.921ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = ChainSuccessorSaga user_builtin_id = 001de000-05e4-4000-8000-000000000002
4082025-08-28T21:45:02.922ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = ChainSuccessorSaga user_builtin_id = 001de000-05e4-4000-8000-000000000002
4092025-08-28T21:45:02.923ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = ChainSuccessorSaga user_builtin_id = 001de000-05e4-4000-8000-000000000002
4102025-08-28T21:45:02.924ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = ChainSuccessorSaga user_builtin_id = 001de000-05e4-4000-8000-000000000002
4112025-08-28T21:45:02.924ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = ChainSuccessorSaga user_builtin_id = 001de000-05e4-4000-8000-000000000002
4122025-08-28T21:45:02.926ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = ChainSuccessorSaga user_builtin_id = 001de000-05e4-4000-8000-000000000002
4132025-08-28T21:45:02.929ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: 9a9c1a75-9cd1-4e13-a807-276e1ce5e24f, lookup_type: ById(9a9c1a75-9cd1-4e13-a807-276e1ce5e24f) }, key: bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7, lookup_type: ById(bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7) } result = Ok(()) saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = ChainSuccessorSaga user_builtin_id = 001de000-05e4-4000-8000-000000000002
4142025-08-28T21:45:02.929ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = ChainSuccessorSaga user_builtin_id = 001de000-05e4-4000-8000-000000000002
4152025-08-28T21:45:02.929ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_node = ChainSuccessorSaga user_builtin_id = 001de000-05e4-4000-8000-000000000002
4162025-08-28T21:45:02.935ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 intended_state = destroyed karmic_state = WillReincarnate needs_reincarnation = false saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update
4172025-08-28T21:45:02.935ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
4182025-08-28T21:45:02.935ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
4192025-08-28T21:45:02.938ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
4202025-08-28T21:45:02.938ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
4212025-08-28T21:45:02.941ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
4222025-08-28T21:45:02.941ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
4232025-08-28T21:45:02.945ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
4242025-08-28T21:45:02.945ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
4252025-08-28T21:45:02.953ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
4262025-08-28T21:45:02.953ZINFOnexus (SagaQuiesceHandle): tracked saga has finished file = nexus/types/src/quiesce.rs:513 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7
4272025-08-28T21:45:02.953ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:433 saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 saga_name = instance-update saga_result = SagaResult { saga_id: 52c580a6-fa66-4567-9156-fd1fba1599e7, saga_log: SagaLog { saga_id: 52c580a6-fa66-4567-9156-fd1fba1599e7, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("a1cd6c1d-8861-48b5-8bc9-602b13021f44")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("a1cd6c1d-8861-48b5-8bc9-602b13021f44")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("0504395d-21fd-4484-beae-6d858dd3d13b")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("0504395d-21fd-4484-beae-6d858dd3d13b")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("a1cd6c1d-8861-48b5-8bc9-602b13021f44"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("a1cd6c1d-8861-48b5-8bc9-602b13021f44")}} }) }
4282025-08-28T21:45:02.953ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 52c580a6-fa66-4567-9156-fd1fba1599e7 instance_id = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update
4292025-08-28T21:45:02.953ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
4302025-08-28T21:45:02.953ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066
4312025-08-28T21:45:02.956ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
4322025-08-28T21:45:02.956ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066
4332025-08-28T21:45:02.959ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
4342025-08-28T21:45:02.959ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066
4352025-08-28T21:45:02.963ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
4362025-08-28T21:45:02.963ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066
4372025-08-28T21:45:02.967ZINFOnexus (BackgroundTasks): VPC route manager sled af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
4382025-08-28T21:45:02.967ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4392025-08-28T21:45:02.968ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8677340-b1d8-45e9-96a3-23f9168a91f2", "content-length": "372", "date": "Thu, 28 Aug 2025 21:45:02 GMT"} })
4402025-08-28T21:45:02.968ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4412025-08-28T21:45:02.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4422025-08-28T21:45:02.969ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
4432025-08-28T21:45:02.969ZINFOnexus (SagaQuiesceHandle): tracked saga has finished file = nexus/types/src/quiesce.rs:513 saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066
4442025-08-28T21:45:02.969ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:433 saga_id = 95a104d0-49d7-4ed0-97f0-cbdfa240a066 saga_name = start-instance-update saga_result = SagaResult { saga_id: 95a104d0-49d7-4ed0-97f0-cbdfa240a066, saga_log: SagaLog { saga_id: 95a104d0-49d7-4ed0-97f0-cbdfa240a066, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("dbe1e18b-37e6-4f42-8463-5bc81bc9da9a")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("dbe1e18b-37e6-4f42-8463-5bc81bc9da9a")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("dbe1e18b-37e6-4f42-8463-5bc81bc9da9a"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("dbe1e18b-37e6-4f42-8463-5bc81bc9da9a")}} }) }
4452025-08-28T21:45:02.982ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
4462025-08-28T21:45:02.982ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
4472025-08-28T21:45:02.982ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "eda14749-0119-4667-a851-d6dcced7b3a8", "date": "Thu, 28 Aug 2025 21:45:02 GMT"} })
4482025-08-28T21:45:02.982ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4492025-08-28T21:45:02.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4502025-08-28T21:45:02.984ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4512025-08-28T21:45:02.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4522025-08-28T21:45:02.987ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4532025-08-28T21:45:02.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4542025-08-28T21:45:02.990ZINFOnexus (BackgroundTasks): VPC route manager sled af8277ed-838c-4274-8629-14eae35fd0e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
4552025-08-28T21:45:02.990ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4562025-08-28T21:45:02.991ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "48ff9fe6-5f33-4085-9c23-3cec03804be9", "date": "Thu, 28 Aug 2025 21:45:02 GMT"} })
4572025-08-28T21:45:02.992ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 139.19023ms iteration = 27 status = {}
4582025-08-28T21:45:03.337ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 96400624-4489-4dc9-98d8-337aef6d30d1 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
4592025-08-28T21:45:03.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 96400624-4489-4dc9-98d8-337aef6d30d1 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
4602025-08-28T21:45:03.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2557 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 96400624-4489-4dc9-98d8-337aef6d30d1 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
4612025-08-28T21:45:03.473ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46619 req_id = 82e42810-aaf6-4fdb-a6f0-ee4d9eb635a8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100 user_builtin_id = 001de000-05e4-4000-8000-000000000002
4622025-08-28T21:45:03.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46619 req_id = 82e42810-aaf6-4fdb-a6f0-ee4d9eb635a8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100 user_builtin_id = 001de000-05e4-4000-8000-000000000002
4632025-08-28T21:45:03.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 3526 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46619 req_id = 82e42810-aaf6-4fdb-a6f0-ee4d9eb635a8 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
4642025-08-28T21:45:03.838ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4652025-08-28T21:45:03.838ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
4662025-08-28T21:45:03.840ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4672025-08-28T21:45:03.840ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
4682025-08-28T21:45:03.842ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4692025-08-28T21:45:03.843ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = ConsoleSession { parent: Fleet, key: 81a01eda-ac4b-404c-98bb-3e70c031d0d6 (console_session), lookup_type: ById(81a01eda-ac4b-404c-98bb-3e70c031d0d6) } result = Ok(())
4702025-08-28T21:45:03.843ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4712025-08-28T21:45:03.844ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
4722025-08-28T21:45:03.845ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4732025-08-28T21:45:03.845ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
4742025-08-28T21:45:03.847ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4752025-08-28T21:45:03.847ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
4762025-08-28T21:45:03.849ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4772025-08-28T21:45:03.849ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
4782025-08-28T21:45:03.851ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4792025-08-28T21:45:03.852ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), lookup_type: ById(d39666d5-c52f-4734-9b61-e44c37604a64) } result = Ok(())
4802025-08-28T21:45:03.852ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4812025-08-28T21:45:03.852ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
4822025-08-28T21:45:03.854ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4832025-08-28T21:45:03.855ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = ConsoleSession { parent: Fleet, key: 81a01eda-ac4b-404c-98bb-3e70c031d0d6 (console_session), lookup_type: ById(81a01eda-ac4b-404c-98bb-3e70c031d0d6) } result = Ok(())
4842025-08-28T21:45:03.855ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4852025-08-28T21:45:03.855ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
4862025-08-28T21:45:03.860ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4872025-08-28T21:45:03.860ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
4882025-08-28T21:45:03.861ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4892025-08-28T21:45:03.862ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
4902025-08-28T21:45:03.863ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4912025-08-28T21:45:03.863ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
4922025-08-28T21:45:03.865ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4932025-08-28T21:45:03.865ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
4942025-08-28T21:45:03.866ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4952025-08-28T21:45:03.868ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), lookup_type: ById(d39666d5-c52f-4734-9b61-e44c37604a64) } result = Ok(())
4962025-08-28T21:45:03.868ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4972025-08-28T21:45:03.868ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
4982025-08-28T21:45:03.869ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4992025-08-28T21:45:03.870ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
5002025-08-28T21:45:03.871ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5012025-08-28T21:45:03.871ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
5022025-08-28T21:45:03.872ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
5032025-08-28T21:45:03.873ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) } result = Ok(())
5042025-08-28T21:45:03.873ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5052025-08-28T21:45:03.874ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5062025-08-28T21:45:03.876ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5072025-08-28T21:45:03.876ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5082025-08-28T21:45:03.878ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 roles = RoleSet { roles: {(Silo, 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, "admin")} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5092025-08-28T21:45:03.879ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 resource = AuditLog result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5102025-08-28T21:45:03.879ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5112025-08-28T21:45:03.879ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5122025-08-28T21:45:03.884ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5132025-08-28T21:45:03.884ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5142025-08-28T21:45:03.885ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5152025-08-28T21:45:03.885ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5162025-08-28T21:45:03.887ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5172025-08-28T21:45:03.887ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5182025-08-28T21:45:03.889ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5192025-08-28T21:45:03.889ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5202025-08-28T21:45:03.892ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5212025-08-28T21:45:03.892ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5222025-08-28T21:45:03.894ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5232025-08-28T21:45:03.894ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5242025-08-28T21:45:03.896ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5252025-08-28T21:45:03.896ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5262025-08-28T21:45:03.898ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 roles = RoleSet { roles: {(Silo, 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, "admin")} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5272025-08-28T21:45:03.902ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: 9a9c1a75-9cd1-4e13-a807-276e1ce5e24f, lookup_type: ByName("proj-e359e85c650") }, key: bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7, lookup_type: ByName("instance-3b99e99a5c1") } result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5282025-08-28T21:45:03.902ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5292025-08-28T21:45:03.902ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5302025-08-28T21:45:03.904ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5312025-08-28T21:45:03.904ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5322025-08-28T21:45:03.907ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5332025-08-28T21:45:03.907ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5342025-08-28T21:45:03.909ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5352025-08-28T21:45:03.909ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5362025-08-28T21:45:03.911ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 roles = RoleSet { roles: {(Silo, 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, "admin")} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5372025-08-28T21:45:03.914ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: 9a9c1a75-9cd1-4e13-a807-276e1ce5e24f, lookup_type: ByName("proj-e359e85c650") }, key: bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7, lookup_type: ByName("instance-3b99e99a5c1") } result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5382025-08-28T21:45:03.917ZINFOnexus (dropshot_external): set intended instance state authenticated = true changed = false file = nexus/db-queries/src/db/datastore/instance.rs:812 instance_id = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 intended_state = destroyed local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
5392025-08-28T21:45:03.917ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
5402025-08-28T21:45:03.917ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
5412025-08-28T21:45:03.918ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
5422025-08-28T21:45:03.920ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Fleet result = Ok(())
5432025-08-28T21:45:03.920ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
5442025-08-28T21:45:03.920ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
5452025-08-28T21:45:03.923ZINFOnexus (SagaQuiesceHandle): tracking newly created saga file = nexus/types/src/quiesce.rs:374 saga_id = 9c760678-6d79-48e0-85c2-50443526c62f
5462025-08-28T21:45:03.923ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:283 saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete
5472025-08-28T21:45:03.923ZINFOnexus (SEC): saga create dag = {"end_node":5,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,0,null],[3,5,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"instance_delete.instance_delete_nat","label":"InstanceDeleteNat","name":"no_result4"}},{"Action":{"action_name":"instance_delete.instance_delete_record","label":"InstanceDeleteRecord","name":"no_result1"}},{"Action":{"action_name":"instance_delete.delete_network_interfaces","label":"DeleteNetworkInterfaces","name":"no_result2"}},{"Action":{"action_name":"instance_delete.deallocate_external_ip","label":"DeallocateExternalIp","name":"no_result3"}},{"Start":{"params":{"authz_instance":{"key":"bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7","lookup_type":{"ByName":"instance-3b99e99a5c1"},"parent":{"key":"9a9c1a75-9cd1-4e13-a807-276e1ce5e24f","lookup_type":{"ByName":"proj-e359e85c650"},"parent":{"key":"427aaf87-3d8a-4dc0-888f-bfc71eaeae3f","lookup_type":{"ById":"427aaf87-3d8a-4dc0-888f-bfc71eaeae3f"},"parent":null}}},"boundary_switches":["switch0"],"instance":{"auto_restart":{"cooldown":null,"policy":null},"boot_disk_id":"6be0decb-489b-4176-b68f-bb4368fca0be","hostname":"localshark","identity":{"description":"","id":"bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7","name":"instance-3b99e99a5c1","time_created":"2025-08-28T21:44:39.046925Z","time_deleted":null,"time_modified":"2025-08-28T21:44:59.735377Z"},"intended_state":"Destroyed","memory":1073741824,"ncpus":2,"project_id":"9a9c1a75-9cd1-4e13-a807-276e1ce5e24f","runtime_state":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-08-28T21:45:02.513589Z"},"updater_gen":4,"updater_id":null,"user_data":[]},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"427aaf87-3d8a-4dc0-888f-bfc71eaeae3f","silo_user_id":"d39666d5-c52f-4734-9b61-e44c37604a64"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"instance-delete","start_node":4} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
5482025-08-28T21:45:03.923ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete
5492025-08-28T21:45:03.927ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:383 saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete
5502025-08-28T21:45:03.927ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
5512025-08-28T21:45:03.927ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
5522025-08-28T21:45:03.927ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 9c760678-6d79-48e0-85c2-50443526c62f
5532025-08-28T21:45:03.930ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
5542025-08-28T21:45:03.930ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 9c760678-6d79-48e0-85c2-50443526c62f
5552025-08-28T21:45:03.934ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
5562025-08-28T21:45:03.934ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 9c760678-6d79-48e0-85c2-50443526c62f
5572025-08-28T21:45:03.937ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
5582025-08-28T21:45:03.937ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
5592025-08-28T21:45:03.938ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
5602025-08-28T21:45:03.938ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
5612025-08-28T21:45:03.940ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
5622025-08-28T21:45:03.940ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
5632025-08-28T21:45:03.941ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
5642025-08-28T21:45:03.941ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
5652025-08-28T21:45:03.943ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
5662025-08-28T21:45:03.943ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
5672025-08-28T21:45:03.946ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
5682025-08-28T21:45:03.946ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
5692025-08-28T21:45:03.948ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
5702025-08-28T21:45:03.949ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
5712025-08-28T21:45:03.951ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Silo, 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, "admin")} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
5722025-08-28T21:45:03.954ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: 9a9c1a75-9cd1-4e13-a807-276e1ce5e24f, lookup_type: ById(9a9c1a75-9cd1-4e13-a807-276e1ce5e24f) }, key: bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7, lookup_type: ById(bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7) } result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
5732025-08-28T21:45:03.954ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:545 instance_id = bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7
5742025-08-28T21:45:03.954ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
5752025-08-28T21:45:03.954ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
5762025-08-28T21:45:03.956ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
5772025-08-28T21:45:03.957ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
5782025-08-28T21:45:03.958ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
5792025-08-28T21:45:03.958ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
5802025-08-28T21:45:03.959ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteNat silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
5812025-08-28T21:45:03.960ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
5822025-08-28T21:45:03.960ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
5832025-08-28T21:45:03.960ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
5842025-08-28T21:45:03.962ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
5852025-08-28T21:45:03.963ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Fleet result = Ok(())
5862025-08-28T21:45:03.963ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
5872025-08-28T21:45:03.963ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
5882025-08-28T21:45:03.967ZDEBGnexus: notifying dendrite of updates instance_id = Some(bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7 (instance)) switch = switch0
5892025-08-28T21:45:03.967ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1672, tv_nsec: 499174475 } })
5902025-08-28T21:45:03.968ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1205
5912025-08-28T21:45:03.998ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1213 zone_address = fd00:1122:3344:101::2
5922025-08-28T21:45:03.998ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5932025-08-28T21:45:03.999ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "37a4bfec-3239-4b12-9dbb-65519408eda5", "content-length": "26", "date": "Thu, 28 Aug 2025 21:45:03 GMT"} })
5942025-08-28T21:45:03.999ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1216 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5952025-08-28T21:45:04.000ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1250 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5962025-08-28T21:45:04.031ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
5972025-08-28T21:45:04.031ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 0 saga_id = 9c760678-6d79-48e0-85c2-50443526c62f
5982025-08-28T21:45:04.034ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
5992025-08-28T21:45:04.034ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 9c760678-6d79-48e0-85c2-50443526c62f
6002025-08-28T21:45:04.038ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6012025-08-28T21:45:04.038ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6022025-08-28T21:45:04.041ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6032025-08-28T21:45:04.041ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6042025-08-28T21:45:04.044ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6052025-08-28T21:45:04.044ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6062025-08-28T21:45:04.047ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6072025-08-28T21:45:04.047ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6082025-08-28T21:45:04.049ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Silo, 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, "admin")} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6092025-08-28T21:45:04.052ZDEBGnexus (SagaExecutor): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: 9a9c1a75-9cd1-4e13-a807-276e1ce5e24f, lookup_type: ByName("proj-e359e85c650") }, key: bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7, lookup_type: ByName("instance-3b99e99a5c1") } result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6102025-08-28T21:45:04.052ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6112025-08-28T21:45:04.052ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6122025-08-28T21:45:04.125ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6132025-08-28T21:45:04.125ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6142025-08-28T21:45:04.133ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6152025-08-28T21:45:04.133ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6162025-08-28T21:45:04.139ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6172025-08-28T21:45:04.139ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6182025-08-28T21:45:04.148ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6192025-08-28T21:45:04.148ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6202025-08-28T21:45:04.151ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
6212025-08-28T21:45:04.151ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 1 saga_id = 9c760678-6d79-48e0-85c2-50443526c62f
6222025-08-28T21:45:04.155ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
6232025-08-28T21:45:04.155ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 9c760678-6d79-48e0-85c2-50443526c62f
6242025-08-28T21:45:04.159ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6252025-08-28T21:45:04.159ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6262025-08-28T21:45:04.161ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6272025-08-28T21:45:04.162ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6282025-08-28T21:45:04.164ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6292025-08-28T21:45:04.165ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6302025-08-28T21:45:04.166ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6312025-08-28T21:45:04.167ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6322025-08-28T21:45:04.169ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Silo, 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, "admin")} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6332025-08-28T21:45:04.172ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: 9a9c1a75-9cd1-4e13-a807-276e1ce5e24f, lookup_type: ByName("proj-e359e85c650") }, key: bf804d9f-7e4b-4ccd-8eec-cacaaf564ab7, lookup_type: ByName("instance-3b99e99a5c1") } result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6342025-08-28T21:45:04.172ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6352025-08-28T21:45:04.173ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6362025-08-28T21:45:04.180ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Signaled
6372025-08-28T21:45:04.180ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6382025-08-28T21:45:04.180ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
6392025-08-28T21:45:04.180ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 9c760678-6d79-48e0-85c2-50443526c62f
6402025-08-28T21:45:04.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
6412025-08-28T21:45:04.183ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
6422025-08-28T21:45:04.183ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 9c760678-6d79-48e0-85c2-50443526c62f
6432025-08-28T21:45:04.186ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = DeallocateExternalIp silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6442025-08-28T21:45:04.187ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = DeallocateExternalIp silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6452025-08-28T21:45:04.192ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6462025-08-28T21:45:04.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
6472025-08-28T21:45:04.200ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6482025-08-28T21:45:04.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
6492025-08-28T21:45:04.202ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6502025-08-28T21:45:04.204ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
6512025-08-28T21:45:04.204ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6522025-08-28T21:45:04.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
6532025-08-28T21:45:04.206ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6542025-08-28T21:45:04.208ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
6552025-08-28T21:45:04.208ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6562025-08-28T21:45:04.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
6572025-08-28T21:45:04.232ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = DeallocateExternalIp silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6582025-08-28T21:45:04.232ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_node = DeallocateExternalIp silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
6592025-08-28T21:45:04.241ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
6602025-08-28T21:45:04.241ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a2dbaf8-c31d-4317-bb8a-351682c25aeb", "content-length": "691", "date": "Thu, 28 Aug 2025 21:45:04 GMT"} })
6612025-08-28T21:45:04.241ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
6622025-08-28T21:45:04.241ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
6632025-08-28T21:45:04.241ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
6642025-08-28T21:45:04.242ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 61.746142ms iteration = 27 status = {}
6652025-08-28T21:45:04.317ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
6662025-08-28T21:45:04.317ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 9c760678-6d79-48e0-85c2-50443526c62f
6672025-08-28T21:45:04.322ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
6682025-08-28T21:45:04.322ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 9c760678-6d79-48e0-85c2-50443526c62f
6692025-08-28T21:45:04.325ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
6702025-08-28T21:45:04.325ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 9c760678-6d79-48e0-85c2-50443526c62f
6712025-08-28T21:45:04.327ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 9c760678-6d79-48e0-85c2-50443526c62f sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
6722025-08-28T21:45:04.328ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 9c760678-6d79-48e0-85c2-50443526c62f
6732025-08-28T21:45:04.334ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
6742025-08-28T21:45:04.334ZINFOnexus (SagaQuiesceHandle): tracked saga has finished file = nexus/types/src/quiesce.rs:513 saga_id = 9c760678-6d79-48e0-85c2-50443526c62f
6752025-08-28T21:45:04.334ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:433 saga_id = 9c760678-6d79-48e0-85c2-50443526c62f saga_name = instance-delete saga_result = SagaResult { saga_id: 9c760678-6d79-48e0-85c2-50443526c62f, saga_log: SagaLog { saga_id: 9c760678-6d79-48e0-85c2-50443526c62f, unwinding: false, events: [N004 started, N004 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N005 started, N005 succeeded], node_status: {0: Succeeded(Null), 1: Succeeded(Null), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"no_result1": Null, "no_result2": Null, "no_result3": Null, "no_result4": Null} }) }
6762025-08-28T21:45:04.334ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
6772025-08-28T21:45:04.334ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Signaled
6782025-08-28T21:45:04.334ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
6792025-08-28T21:45:04.334ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6802025-08-28T21:45:04.335ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
6812025-08-28T21:45:04.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6822025-08-28T21:45:04.336ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6832025-08-28T21:45:04.337ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
6842025-08-28T21:45:04.338ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
6852025-08-28T21:45:04.338ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6862025-08-28T21:45:04.338ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6872025-08-28T21:45:04.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6882025-08-28T21:45:04.340ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 roles = RoleSet { roles: {(Silo, 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, "admin")} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
6892025-08-28T21:45:04.340ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6902025-08-28T21:45:04.341ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 resource = AuditLog result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
6912025-08-28T21:45:04.341ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
6922025-08-28T21:45:04.341ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
6932025-08-28T21:45:04.342ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6942025-08-28T21:45:04.342ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6952025-08-28T21:45:04.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6962025-08-28T21:45:04.346ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 508528 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f6b32319-9124-470f-a95a-8b9ef4a65e02 response_code = 204 uri = /v1/instances/instance-3b99e99a5c1?project=proj-e359e85c650
6972025-08-28T21:45:04.347ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6982025-08-28T21:45:04.347ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
6992025-08-28T21:45:04.349ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7002025-08-28T21:45:04.349ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
7012025-08-28T21:45:04.350ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
7022025-08-28T21:45:04.352ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = ConsoleSession { parent: Fleet, key: 81a01eda-ac4b-404c-98bb-3e70c031d0d6 (console_session), lookup_type: ById(81a01eda-ac4b-404c-98bb-3e70c031d0d6) } result = Ok(())
7032025-08-28T21:45:04.352ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7042025-08-28T21:45:04.352ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
7052025-08-28T21:45:04.353ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7062025-08-28T21:45:04.353ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 86a91057-f789-4dc9-8fa7-9369f9ae9405 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
7072025-08-28T21:45:04.353ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
7082025-08-28T21:45:04.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 86a91057-f789-4dc9-8fa7-9369f9ae9405 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
7092025-08-28T21:45:04.355ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7102025-08-28T21:45:04.355ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
7112025-08-28T21:45:04.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 1949 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 86a91057-f789-4dc9-8fa7-9369f9ae9405 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
7122025-08-28T21:45:04.357ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7132025-08-28T21:45:04.357ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
7142025-08-28T21:45:04.358ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
7152025-08-28T21:45:04.360ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), lookup_type: ById(d39666d5-c52f-4734-9b61-e44c37604a64) } result = Ok(())
7162025-08-28T21:45:04.360ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7172025-08-28T21:45:04.360ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
7182025-08-28T21:45:04.361ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
7192025-08-28T21:45:04.363ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = ConsoleSession { parent: Fleet, key: 81a01eda-ac4b-404c-98bb-3e70c031d0d6 (console_session), lookup_type: ById(81a01eda-ac4b-404c-98bb-3e70c031d0d6) } result = Ok(())
7202025-08-28T21:45:04.363ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7212025-08-28T21:45:04.363ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
7222025-08-28T21:45:04.366ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7232025-08-28T21:45:04.366ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
7242025-08-28T21:45:04.367ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7252025-08-28T21:45:04.368ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
7262025-08-28T21:45:04.369ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7272025-08-28T21:45:04.369ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
7282025-08-28T21:45:04.371ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7292025-08-28T21:45:04.371ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
7302025-08-28T21:45:04.372ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
7312025-08-28T21:45:04.373ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), lookup_type: ById(d39666d5-c52f-4734-9b61-e44c37604a64) } result = Ok(())
7322025-08-28T21:45:04.373ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7332025-08-28T21:45:04.374ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
7342025-08-28T21:45:04.375ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7352025-08-28T21:45:04.375ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
7362025-08-28T21:45:04.375ZINFOnexus (BackgroundTasks): VPC route manager sled af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7372025-08-28T21:45:04.375ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7382025-08-28T21:45:04.376ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc23a6b9-036e-4b5b-9079-2598ce5351b4", "content-length": "372", "date": "Thu, 28 Aug 2025 21:45:04 GMT"} })
7392025-08-28T21:45:04.376ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7402025-08-28T21:45:04.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7412025-08-28T21:45:04.376ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7422025-08-28T21:45:04.376ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
7432025-08-28T21:45:04.378ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
7442025-08-28T21:45:04.379ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) } result = Ok(())
7452025-08-28T21:45:04.379ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7462025-08-28T21:45:04.379ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7472025-08-28T21:45:04.382ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7482025-08-28T21:45:04.382ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7492025-08-28T21:45:04.384ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 roles = RoleSet { roles: {(Silo, 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, "admin")} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7502025-08-28T21:45:04.385ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 resource = AuditLog result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7512025-08-28T21:45:04.385ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7522025-08-28T21:45:04.385ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7532025-08-28T21:45:04.389ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7542025-08-28T21:45:04.389ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7552025-08-28T21:45:04.390ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
7562025-08-28T21:45:04.390ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7572025-08-28T21:45:04.391ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7582025-08-28T21:45:04.391ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "015c55ea-3bac-40b9-b54b-808264070ef3", "date": "Thu, 28 Aug 2025 21:45:04 GMT"} })
7592025-08-28T21:45:04.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7602025-08-28T21:45:04.391ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7612025-08-28T21:45:04.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7622025-08-28T21:45:04.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7632025-08-28T21:45:04.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7642025-08-28T21:45:04.393ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7652025-08-28T21:45:04.393ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7662025-08-28T21:45:04.395ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7672025-08-28T21:45:04.395ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7682025-08-28T21:45:04.395ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7692025-08-28T21:45:04.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7702025-08-28T21:45:04.397ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7712025-08-28T21:45:04.397ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7722025-08-28T21:45:04.398ZINFOnexus (BackgroundTasks): VPC route manager sled af8277ed-838c-4274-8629-14eae35fd0e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7732025-08-28T21:45:04.398ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7742025-08-28T21:45:04.398ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fe8da72d-932b-45a8-b590-e8d7dd85ae5b", "date": "Thu, 28 Aug 2025 21:45:04 GMT"} })
7752025-08-28T21:45:04.400ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7762025-08-28T21:45:04.400ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 65.94008ms iteration = 28 status = {}
7772025-08-28T21:45:04.400ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7782025-08-28T21:45:04.402ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7792025-08-28T21:45:04.402ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7802025-08-28T21:45:04.408ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 roles = RoleSet { roles: {(Silo, 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, "admin")} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7812025-08-28T21:45:04.411ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: 9a9c1a75-9cd1-4e13-a807-276e1ce5e24f, lookup_type: ByName("proj-e359e85c650") }, key: 6be0decb-489b-4176-b68f-bb4368fca0be, lookup_type: ByName("disk-7c251f2d3e8") } result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7822025-08-28T21:45:04.411ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7832025-08-28T21:45:04.411ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7842025-08-28T21:45:04.413ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7852025-08-28T21:45:04.413ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7862025-08-28T21:45:04.415ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7872025-08-28T21:45:04.415ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7882025-08-28T21:45:04.417ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7892025-08-28T21:45:04.417ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7902025-08-28T21:45:04.419ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7912025-08-28T21:45:04.419ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7922025-08-28T21:45:04.422ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7932025-08-28T21:45:04.422ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7942025-08-28T21:45:04.424ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7952025-08-28T21:45:04.425ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7962025-08-28T21:45:04.427ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 roles = RoleSet { roles: {(Silo, 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, "admin")} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7972025-08-28T21:45:04.431ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: 9a9c1a75-9cd1-4e13-a807-276e1ce5e24f, lookup_type: ById(9a9c1a75-9cd1-4e13-a807-276e1ce5e24f) }, key: 6be0decb-489b-4176-b68f-bb4368fca0be, lookup_type: ById(6be0decb-489b-4176-b68f-bb4368fca0be) } result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
7982025-08-28T21:45:04.431ZINFOnexus (SagaQuiesceHandle): tracking newly created saga file = nexus/types/src/quiesce.rs:374 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
7992025-08-28T21:45:04.431ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:283 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3 saga_name = disk-delete
8002025-08-28T21:45:04.431ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,5,null],[4,6,null],[6,7,null],[5,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[3,4,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"disk_delete.delete_disk_record","label":"DeleteDiskRecord","name":"deleted_disk"}},{"Action":{"action_name":"disk_delete.space_account","label":"SpaceAccount","name":"no_result1"}},{"Constant":{"name":"params_for_volume_delete_subsaga","value":{"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"427aaf87-3d8a-4dc0-888f-bfc71eaeae3f","silo_user_id":"d39666d5-c52f-4734-9b61-e44c37604a64"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"4a011530-4d38-4800-a6aa-76e36f0ed031"}}},{"SubsagaStart":{"params_node_name":"params_for_volume_delete_subsaga","saga_name":"volume-delete"}},{"Action":{"action_name":"volume_delete.decrease_crucible_resource_count","label":"DecreaseCrucibleResourceCount","name":"crucible_resources_to_delete"}},{"Action":{"action_name":"volume_delete.delete_crucible_regions","label":"DeleteCrucibleRegions","name":"no_result_1"}},{"Action":{"action_name":"volume_delete.delete_crucible_running_snapshots","label":"DeleteCrucibleRunningSnapshots","name":"no_result_2"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshots","label":"DeleteCrucibleSnapshots","name":"no_result_3"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshot_records","label":"DeleteCrucibleSnapshotRecords","name":"no_result_4"}},{"Action":{"action_name":"volume_delete.find_freed_crucible_regions","label":"FindFreedCrucibleRegions","name":"freed_crucible_regions"}},{"Action":{"action_name":"volume_delete.delete_freed_crucible_regions","label":"DeleteFreedCrucibleRegions","name":"no_result_5"}},{"Action":{"action_name":"volume_delete.hard_delete_volume_record","label":"HardDeleteVolumeRecord","name":"volume_hard_deleted"}},{"SubsagaEnd":{"name":"volume_delete_subsaga_no_result"}},{"Start":{"params":{"disk_id":"6be0decb-489b-4176-b68f-bb4368fca0be","project_id":"9a9c1a75-9cd1-4e13-a807-276e1ce5e24f","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"427aaf87-3d8a-4dc0-888f-bfc71eaeae3f","silo_user_id":"d39666d5-c52f-4734-9b61-e44c37604a64"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"4a011530-4d38-4800-a6aa-76e36f0ed031"}}},"End"]},"saga_name":"disk-delete","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3 saga_name = disk-delete sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8012025-08-28T21:45:04.431ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3 saga_name = disk-delete
8022025-08-28T21:45:04.435ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:383 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3 saga_name = disk-delete
8032025-08-28T21:45:04.435ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3 saga_name = disk-delete sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8042025-08-28T21:45:04.435ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8052025-08-28T21:45:04.435ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8062025-08-28T21:45:04.439ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8072025-08-28T21:45:04.439ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8082025-08-28T21:45:04.442ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8092025-08-28T21:45:04.442ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8102025-08-28T21:45:04.455ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8112025-08-28T21:45:04.455ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": String("7e85771a-971b-4082-a024-53a9d0482375"), "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("6be0decb-489b-4176-b68f-bb4368fca0be"), "name": String("disk-7c251f2d3e8"), "time_created": String("2025-08-28T21:44:37.564824Z"), "time_deleted": Null, "time_modified": String("2025-08-28T21:44:37.564824Z")}, "pantry_address": Null, "project_id": String("9a9c1a75-9cd1-4e13-a807-276e1ce5e24f"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2025-08-28T21:44:38.695932Z")}, "size": Number(2147483648), "slot": Null, "volume_id": String("4a011530-4d38-4800-a6aa-76e36f0ed031")}) node_id = 0 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8122025-08-28T21:45:04.458ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8132025-08-28T21:45:04.458ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8142025-08-28T21:45:04.462ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3 saga_name = disk-delete saga_node = SpaceAccount silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
8152025-08-28T21:45:04.462ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3 saga_name = disk-delete saga_node = SpaceAccount silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
8162025-08-28T21:45:04.471ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8172025-08-28T21:45:04.471ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 1 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8182025-08-28T21:45:04.475ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8192025-08-28T21:45:04.475ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8202025-08-28T21:45:04.478ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8212025-08-28T21:45:04.478ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("427aaf87-3d8a-4dc0-888f-bfc71eaeae3f"), "silo_user_id": String("d39666d5-c52f-4734-9b61-e44c37604a64")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("4a011530-4d38-4800-a6aa-76e36f0ed031")}) node_id = 2 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8222025-08-28T21:45:04.478ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46619 req_id = c1e49b78-e7ef-4ac8-87b5-091644f64cf2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100 user_builtin_id = 001de000-05e4-4000-8000-000000000002
8232025-08-28T21:45:04.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46619 req_id = c1e49b78-e7ef-4ac8-87b5-091644f64cf2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100 user_builtin_id = 001de000-05e4-4000-8000-000000000002
8242025-08-28T21:45:04.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2845 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46619 req_id = c1e49b78-e7ef-4ac8-87b5-091644f64cf2 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
8252025-08-28T21:45:04.481ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8262025-08-28T21:45:04.481ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8272025-08-28T21:45:04.484ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8282025-08-28T21:45:04.484ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8292025-08-28T21:45:04.488ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8302025-08-28T21:45:04.488ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8312025-08-28T21:45:04.519ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8322025-08-28T21:45:04.519ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("9dd25452-1a34-4488-90de-f85425476605"), String("5ebd98ed-0084-4fb2-9c54-8f71f8bf2b66"), String("7247ed88-2060-4d7b-b999-695f7a55b302")]}}) node_id = 4 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8332025-08-28T21:45:04.522ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8342025-08-28T21:45:04.522ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8352025-08-28T21:45:04.526ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8362025-08-28T21:45:04.526ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8372025-08-28T21:45:04.529ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8382025-08-28T21:45:04.529ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8392025-08-28T21:45:04.568ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 136.231083ms file = nexus/src/app/crucible.rs:864 region_id = 7247ed88-2060-4d7b-b999-695f7a55b302 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3 saga_name = disk-delete
8402025-08-28T21:45:04.571ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 104.731224ms file = nexus/src/app/crucible.rs:864 region_id = 9dd25452-1a34-4488-90de-f85425476605 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3 saga_name = disk-delete
8412025-08-28T21:45:04.574ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 138.937691ms file = nexus/src/app/crucible.rs:864 region_id = 5ebd98ed-0084-4fb2-9c54-8f71f8bf2b66 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3 saga_name = disk-delete
8422025-08-28T21:45:04.681ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:807 region_id = 9dd25452-1a34-4488-90de-f85425476605 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3 saga_name = disk-delete
8432025-08-28T21:45:04.709ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:807 region_id = 7247ed88-2060-4d7b-b999-695f7a55b302 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3 saga_name = disk-delete
8442025-08-28T21:45:04.719ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:807 region_id = 5ebd98ed-0084-4fb2-9c54-8f71f8bf2b66 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3 saga_name = disk-delete
8452025-08-28T21:45:04.756ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8462025-08-28T21:45:04.756ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8472025-08-28T21:45:04.770ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8482025-08-28T21:45:04.770ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8492025-08-28T21:45:04.776ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8502025-08-28T21:45:04.776ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8512025-08-28T21:45:04.780ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8522025-08-28T21:45:04.780ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8532025-08-28T21:45:04.785ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8542025-08-28T21:45:04.785ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8552025-08-28T21:45:04.789ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8562025-08-28T21:45:04.789ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8572025-08-28T21:45:04.801ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8582025-08-28T21:45:04.801ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"datasets_and_regions": Array [], "volumes": Array []}) node_id = 9 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8592025-08-28T21:45:04.805ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8602025-08-28T21:45:04.805ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8612025-08-28T21:45:04.810ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8622025-08-28T21:45:04.810ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8632025-08-28T21:45:04.813ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8642025-08-28T21:45:04.813ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8652025-08-28T21:45:04.819ZINFOnexus (SagaExecutor): allocated regions for 4a011530-4d38-4800-a6aa-76e36f0ed031 is empty, calling volume_hard_delete file = nexus/src/app/sagas/volume_delete.rs:523 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3 saga_name = disk-delete
8662025-08-28T21:45:04.824ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8672025-08-28T21:45:04.824ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 11 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8682025-08-28T21:45:04.828ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8692025-08-28T21:45:04.828ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8702025-08-28T21:45:04.831ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8712025-08-28T21:45:04.831ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 12 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8722025-08-28T21:45:04.834ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8732025-08-28T21:45:04.834ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8742025-08-28T21:45:04.838ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8752025-08-28T21:45:04.838ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8762025-08-28T21:45:04.840ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3 sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8772025-08-28T21:45:04.840ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8782025-08-28T21:45:04.847ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3 saga_name = disk-delete sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
8792025-08-28T21:45:04.847ZINFOnexus (SagaQuiesceHandle): tracked saga has finished file = nexus/types/src/quiesce.rs:513 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3
8802025-08-28T21:45:04.847ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:433 saga_id = d53f10ab-d970-42a6-8ae1-d23b903177a3 saga_name = disk-delete saga_result = SagaResult { saga_id: d53f10ab-d970-42a6-8ae1-d23b903177a3, saga_log: SagaLog { saga_id: d53f10ab-d970-42a6-8ae1-d23b903177a3, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N006 started, N005 started, N006 succeeded, N005 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": String("7e85771a-971b-4082-a024-53a9d0482375"), "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("6be0decb-489b-4176-b68f-bb4368fca0be"), "name": String("disk-7c251f2d3e8"), "time_created": String("2025-08-28T21:44:37.564824Z"), "time_deleted": Null, "time_modified": String("2025-08-28T21:44:37.564824Z")}, "pantry_address": Null, "project_id": String("9a9c1a75-9cd1-4e13-a807-276e1ce5e24f"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2025-08-28T21:44:38.695932Z")}, "size": Number(2147483648), "slot": Null, "volume_id": String("4a011530-4d38-4800-a6aa-76e36f0ed031")}), 1: Succeeded(Null), 2: Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("427aaf87-3d8a-4dc0-888f-bfc71eaeae3f"), "silo_user_id": String("d39666d5-c52f-4734-9b61-e44c37604a64")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("4a011530-4d38-4800-a6aa-76e36f0ed031")}), 3: Succeeded(Null), 4: Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("9dd25452-1a34-4488-90de-f85425476605"), String("5ebd98ed-0084-4fb2-9c54-8f71f8bf2b66"), String("7247ed88-2060-4d7b-b999-695f7a55b302")]}}), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Object {"datasets_and_regions": Array [], "volumes": Array []}), 10: Succeeded(Null), 11: Succeeded(Bool(true)), 12: Succeeded(Bool(true)), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Bool(true), node_outputs: {"crucible_resources_to_delete": Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("9dd25452-1a34-4488-90de-f85425476605"), String("5ebd98ed-0084-4fb2-9c54-8f71f8bf2b66"), String("7247ed88-2060-4d7b-b999-695f7a55b302")]}}, "deleted_disk": Object {"block_size": String("Traditional"), "create_image_id": String("7e85771a-971b-4082-a024-53a9d0482375"), "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("6be0decb-489b-4176-b68f-bb4368fca0be"), "name": String("disk-7c251f2d3e8"), "time_created": String("2025-08-28T21:44:37.564824Z"), "time_deleted": Null, "time_modified": String("2025-08-28T21:44:37.564824Z")}, "pantry_address": Null, "project_id": String("9a9c1a75-9cd1-4e13-a807-276e1ce5e24f"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2025-08-28T21:44:38.695932Z")}, "size": Number(2147483648), "slot": Null, "volume_id": String("4a011530-4d38-4800-a6aa-76e36f0ed031")}, "freed_crucible_regions": Object {"datasets_and_regions": Array [], "volumes": Array []}, "no_result1": Null, "no_result_1": Null, "no_result_2": Null, "no_result_3": Null, "no_result_4": Null, "no_result_5": Null, "params_for_volume_delete_subsaga": Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("427aaf87-3d8a-4dc0-888f-bfc71eaeae3f"), "silo_user_id": String("d39666d5-c52f-4734-9b61-e44c37604a64")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("4a011530-4d38-4800-a6aa-76e36f0ed031")}, "volume_delete_subsaga_no_result": Bool(true), "volume_hard_deleted": Bool(true)} }) }
8812025-08-28T21:45:04.847ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
8822025-08-28T21:45:04.848ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
8832025-08-28T21:45:04.849ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
8842025-08-28T21:45:04.850ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
8852025-08-28T21:45:04.852ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 roles = RoleSet { roles: {(Silo, 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, "admin")} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
8862025-08-28T21:45:04.853ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 resource = AuditLog result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
8872025-08-28T21:45:04.853ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
8882025-08-28T21:45:04.853ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
8892025-08-28T21:45:04.858ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 510687 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 0ceddf5e-2655-4dae-8a58-16941626e0c0 response_code = 204 uri = /v1/disks/disk-7c251f2d3e8?project=proj-e359e85c650
8902025-08-28T21:45:04.859ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8912025-08-28T21:45:04.859ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
8922025-08-28T21:45:04.861ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8932025-08-28T21:45:04.861ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
8942025-08-28T21:45:04.863ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
8952025-08-28T21:45:04.864ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = ConsoleSession { parent: Fleet, key: 81a01eda-ac4b-404c-98bb-3e70c031d0d6 (console_session), lookup_type: ById(81a01eda-ac4b-404c-98bb-3e70c031d0d6) } result = Ok(())
8962025-08-28T21:45:04.864ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8972025-08-28T21:45:04.864ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
8982025-08-28T21:45:04.865ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8992025-08-28T21:45:04.866ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
9002025-08-28T21:45:04.867ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9012025-08-28T21:45:04.867ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
9022025-08-28T21:45:04.869ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9032025-08-28T21:45:04.869ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
9042025-08-28T21:45:04.871ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
9052025-08-28T21:45:04.872ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), lookup_type: ById(d39666d5-c52f-4734-9b61-e44c37604a64) } result = Ok(())
9062025-08-28T21:45:04.872ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9072025-08-28T21:45:04.872ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
9082025-08-28T21:45:04.874ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
9092025-08-28T21:45:04.875ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = ConsoleSession { parent: Fleet, key: 81a01eda-ac4b-404c-98bb-3e70c031d0d6 (console_session), lookup_type: ById(81a01eda-ac4b-404c-98bb-3e70c031d0d6) } result = Ok(())
9102025-08-28T21:45:04.875ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9112025-08-28T21:45:04.875ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
9122025-08-28T21:45:04.879ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9132025-08-28T21:45:04.879ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
9142025-08-28T21:45:04.881ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9152025-08-28T21:45:04.881ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
9162025-08-28T21:45:04.882ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9172025-08-28T21:45:04.883ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
9182025-08-28T21:45:04.884ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9192025-08-28T21:45:04.884ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
9202025-08-28T21:45:04.886ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
9212025-08-28T21:45:04.887ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), lookup_type: ById(d39666d5-c52f-4734-9b61-e44c37604a64) } result = Ok(())
9222025-08-28T21:45:04.887ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9232025-08-28T21:45:04.887ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
9242025-08-28T21:45:04.888ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9252025-08-28T21:45:04.888ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
9262025-08-28T21:45:04.890ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9272025-08-28T21:45:04.890ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
9282025-08-28T21:45:04.891ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
9292025-08-28T21:45:04.893ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) } result = Ok(())
9302025-08-28T21:45:04.893ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 9752d80e-2a53-4d25-a1d8-88c1a511ed33 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpc-subnets/default?project=proj-e359e85c650&vpc=default
9312025-08-28T21:45:04.893ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 9752d80e-2a53-4d25-a1d8-88c1a511ed33 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpc-subnets/default?project=proj-e359e85c650&vpc=default
9322025-08-28T21:45:04.894ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 9752d80e-2a53-4d25-a1d8-88c1a511ed33 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpc-subnets/default?project=proj-e359e85c650&vpc=default
9332025-08-28T21:45:04.894ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 9752d80e-2a53-4d25-a1d8-88c1a511ed33 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpc-subnets/default?project=proj-e359e85c650&vpc=default
9342025-08-28T21:45:04.896ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 9752d80e-2a53-4d25-a1d8-88c1a511ed33 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpc-subnets/default?project=proj-e359e85c650&vpc=default
9352025-08-28T21:45:04.896ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 9752d80e-2a53-4d25-a1d8-88c1a511ed33 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpc-subnets/default?project=proj-e359e85c650&vpc=default
9362025-08-28T21:45:04.898ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 9752d80e-2a53-4d25-a1d8-88c1a511ed33 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpc-subnets/default?project=proj-e359e85c650&vpc=default
9372025-08-28T21:45:04.899ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 9752d80e-2a53-4d25-a1d8-88c1a511ed33 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpc-subnets/default?project=proj-e359e85c650&vpc=default
9382025-08-28T21:45:04.900ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 9752d80e-2a53-4d25-a1d8-88c1a511ed33 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpc-subnets/default?project=proj-e359e85c650&vpc=default
9392025-08-28T21:45:04.900ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 9752d80e-2a53-4d25-a1d8-88c1a511ed33 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpc-subnets/default?project=proj-e359e85c650&vpc=default
9402025-08-28T21:45:04.903ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 9752d80e-2a53-4d25-a1d8-88c1a511ed33 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpc-subnets/default?project=proj-e359e85c650&vpc=default
9412025-08-28T21:45:04.903ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 9752d80e-2a53-4d25-a1d8-88c1a511ed33 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpc-subnets/default?project=proj-e359e85c650&vpc=default
9422025-08-28T21:45:04.905ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 9752d80e-2a53-4d25-a1d8-88c1a511ed33 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpc-subnets/default?project=proj-e359e85c650&vpc=default
9432025-08-28T21:45:04.906ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 9752d80e-2a53-4d25-a1d8-88c1a511ed33 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpc-subnets/default?project=proj-e359e85c650&vpc=default
9442025-08-28T21:45:04.908ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 9752d80e-2a53-4d25-a1d8-88c1a511ed33 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpc-subnets/default?project=proj-e359e85c650&vpc=default
9452025-08-28T21:45:04.908ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 9752d80e-2a53-4d25-a1d8-88c1a511ed33 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpc-subnets/default?project=proj-e359e85c650&vpc=default
9462025-08-28T21:45:04.910ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 9752d80e-2a53-4d25-a1d8-88c1a511ed33 roles = RoleSet { roles: {(Silo, 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, "admin")} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpc-subnets/default?project=proj-e359e85c650&vpc=default
9472025-08-28T21:45:04.914ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 9752d80e-2a53-4d25-a1d8-88c1a511ed33 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: 9a9c1a75-9cd1-4e13-a807-276e1ce5e24f, lookup_type: ByName("proj-e359e85c650") }, key: de791e81-9102-48fa-a5bf-0e900af5e450, lookup_type: ByName("default") }, key: 8c24ffa2-9d72-4a07-a9fe-3434897c2d5f, lookup_type: ByName("default") } result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpc-subnets/default?project=proj-e359e85c650&vpc=default
9482025-08-28T21:45:04.914ZINFOnexus (SagaQuiesceHandle): tracking newly created saga file = nexus/types/src/quiesce.rs:374 saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5
9492025-08-28T21:45:04.914ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:283 saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5 saga_name = vpc-subnet-delete
9502025-08-28T21:45:04.914ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"vpc_subnet_delete.vpc_subnet_delete_subnet","label":"VpcSubnetDeleteSubnet","name":"no_result_0"}},{"Action":{"action_name":"vpc_subnet_delete.vpc_subnet_delete_sys_route","label":"VpcSubnetDeleteSysRoute","name":"no_result_1"}},{"Action":{"action_name":"vpc_subnet_delete.vpc_notify_rpw","label":"VpcNotifyRpw","name":"no_result_2"}},{"Start":{"params":{"authz_subnet":{"key":"8c24ffa2-9d72-4a07-a9fe-3434897c2d5f","lookup_type":{"ByName":"default"},"parent":{"key":"de791e81-9102-48fa-a5bf-0e900af5e450","lookup_type":{"ByName":"default"},"parent":{"key":"9a9c1a75-9cd1-4e13-a807-276e1ce5e24f","lookup_type":{"ByName":"proj-e359e85c650"},"parent":{"key":"427aaf87-3d8a-4dc0-888f-bfc71eaeae3f","lookup_type":{"ById":"427aaf87-3d8a-4dc0-888f-bfc71eaeae3f"},"parent":null}}}},"authz_vpc":{"key":"de791e81-9102-48fa-a5bf-0e900af5e450","lookup_type":{"ByName":"default"},"parent":{"key":"9a9c1a75-9cd1-4e13-a807-276e1ce5e24f","lookup_type":{"ByName":"proj-e359e85c650"},"parent":{"key":"427aaf87-3d8a-4dc0-888f-bfc71eaeae3f","lookup_type":{"ById":"427aaf87-3d8a-4dc0-888f-bfc71eaeae3f"},"parent":null}}},"db_subnet":{"custom_router_id":null,"identity":{"description":"The default subnet for default","id":"8c24ffa2-9d72-4a07-a9fe-3434897c2d5f","name":"default","time_created":"2025-08-28T21:44:36.707528Z","time_deleted":null,"time_modified":"2025-08-28T21:44:36.707528Z"},"ipv4_block":"172.30.0.0/22","ipv6_block":"fd4c:8a72:7e16::/64","rcgen":2,"vpc_id":"de791e81-9102-48fa-a5bf-0e900af5e450"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"427aaf87-3d8a-4dc0-888f-bfc71eaeae3f","silo_user_id":"d39666d5-c52f-4734-9b61-e44c37604a64"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"vpc-subnet-delete","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5 saga_name = vpc-subnet-delete sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
9512025-08-28T21:45:04.914ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5 saga_name = vpc-subnet-delete
9522025-08-28T21:45:04.917ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:383 saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5 saga_name = vpc-subnet-delete
9532025-08-28T21:45:04.917ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5 saga_name = vpc-subnet-delete sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
9542025-08-28T21:45:04.917ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
9552025-08-28T21:45:04.917ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5
9562025-08-28T21:45:04.921ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
9572025-08-28T21:45:04.921ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5
9582025-08-28T21:45:04.924ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
9592025-08-28T21:45:04.924ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5
9602025-08-28T21:45:04.927ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5 saga_name = vpc-subnet-delete saga_node = VpcSubnetDeleteSubnet silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
9612025-08-28T21:45:04.927ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5 saga_name = vpc-subnet-delete saga_node = VpcSubnetDeleteSubnet silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
9622025-08-28T21:45:04.929ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5 saga_name = vpc-subnet-delete saga_node = VpcSubnetDeleteSubnet silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
9632025-08-28T21:45:04.929ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5 saga_name = vpc-subnet-delete saga_node = VpcSubnetDeleteSubnet silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
9642025-08-28T21:45:04.931ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5 saga_name = vpc-subnet-delete saga_node = VpcSubnetDeleteSubnet silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
9652025-08-28T21:45:04.932ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5 saga_name = vpc-subnet-delete saga_node = VpcSubnetDeleteSubnet silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
9662025-08-28T21:45:04.934ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5 saga_name = vpc-subnet-delete saga_node = VpcSubnetDeleteSubnet silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
9672025-08-28T21:45:04.934ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5 saga_name = vpc-subnet-delete saga_node = VpcSubnetDeleteSubnet silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
9682025-08-28T21:45:04.936ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Silo, 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, "admin")} } saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5 saga_name = vpc-subnet-delete saga_node = VpcSubnetDeleteSubnet silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
9692025-08-28T21:45:04.940ZDEBGnexus (SagaExecutor): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: 9a9c1a75-9cd1-4e13-a807-276e1ce5e24f, lookup_type: ByName("proj-e359e85c650") }, key: de791e81-9102-48fa-a5bf-0e900af5e450, lookup_type: ByName("default") }, key: 8c24ffa2-9d72-4a07-a9fe-3434897c2d5f, lookup_type: ByName("default") } result = Ok(()) saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5 saga_name = vpc-subnet-delete saga_node = VpcSubnetDeleteSubnet silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
9702025-08-28T21:45:04.940ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5 saga_name = vpc-subnet-delete saga_node = VpcSubnetDeleteSubnet silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
9712025-08-28T21:45:04.940ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5 saga_name = vpc-subnet-delete saga_node = VpcSubnetDeleteSubnet silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
9722025-08-28T21:45:04.946ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
9732025-08-28T21:45:04.946ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 0 saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5
9742025-08-28T21:45:04.949ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
9752025-08-28T21:45:04.949ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5
9762025-08-28T21:45:04.953ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5 saga_name = vpc-subnet-delete saga_node = VpcSubnetDeleteSysRoute silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
9772025-08-28T21:45:04.953ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5 saga_name = vpc-subnet-delete saga_node = VpcSubnetDeleteSysRoute silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
9782025-08-28T21:45:04.992ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
9792025-08-28T21:45:04.992ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 1 saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5
9802025-08-28T21:45:04.995ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
9812025-08-28T21:45:04.995ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5
9822025-08-28T21:45:04.999ZDEBGnexus (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5 saga_name = vpc-subnet-delete saga_node = VpcNotifyRpw silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
9832025-08-28T21:45:04.999ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5 saga_name = vpc-subnet-delete saga_node = VpcNotifyRpw silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64
9842025-08-28T21:45:05.003ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
9852025-08-28T21:45:05.003ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5
9862025-08-28T21:45:05.009ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
9872025-08-28T21:45:05.009ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5
9882025-08-28T21:45:05.012ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
9892025-08-28T21:45:05.012ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5
9902025-08-28T21:45:05.014ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5 sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
9912025-08-28T21:45:05.014ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5
9922025-08-28T21:45:05.020ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5 saga_name = vpc-subnet-delete sec_id = 0fe4e55a-5967-4507-9554-6c41366055df
9932025-08-28T21:45:05.020ZINFOnexus (SagaQuiesceHandle): tracked saga has finished file = nexus/types/src/quiesce.rs:513 saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5
9942025-08-28T21:45:05.020ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:433 saga_id = 23e672c7-f9a1-4da5-997c-a379ac79b5c5 saga_name = vpc-subnet-delete saga_result = SagaResult { saga_id: 23e672c7-f9a1-4da5-997c-a379ac79b5c5, saga_log: SagaLog { saga_id: 23e672c7-f9a1-4da5-997c-a379ac79b5c5, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(Null), 1: Succeeded(Null), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"no_result_0": Null, "no_result_1": Null, "no_result_2": Null} }) }
9952025-08-28T21:45:05.020ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Signaled
9962025-08-28T21:45:05.020ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
9972025-08-28T21:45:05.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9982025-08-28T21:45:05.020ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 161146 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 9752d80e-2a53-4d25-a1d8-88c1a511ed33 response_code = 204 uri = /v1/vpc-subnets/default?project=proj-e359e85c650&vpc=default
9992025-08-28T21:45:05.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10002025-08-28T21:45:05.022ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10012025-08-28T21:45:05.022ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10022025-08-28T21:45:05.022ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
10032025-08-28T21:45:05.024ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10042025-08-28T21:45:05.024ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10052025-08-28T21:45:05.024ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10062025-08-28T21:45:05.024ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
10072025-08-28T21:45:05.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10082025-08-28T21:45:05.025ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
10092025-08-28T21:45:05.026ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10102025-08-28T21:45:05.027ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = ConsoleSession { parent: Fleet, key: 81a01eda-ac4b-404c-98bb-3e70c031d0d6 (console_session), lookup_type: ById(81a01eda-ac4b-404c-98bb-3e70c031d0d6) } result = Ok(())
10112025-08-28T21:45:05.027ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10122025-08-28T21:45:05.028ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
10132025-08-28T21:45:05.028ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10142025-08-28T21:45:05.028ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10152025-08-28T21:45:05.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10162025-08-28T21:45:05.029ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10172025-08-28T21:45:05.029ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
10182025-08-28T21:45:05.030ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10192025-08-28T21:45:05.031ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
10202025-08-28T21:45:05.032ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10212025-08-28T21:45:05.032ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
10222025-08-28T21:45:05.034ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
10232025-08-28T21:45:05.035ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), lookup_type: ById(d39666d5-c52f-4734-9b61-e44c37604a64) } result = Ok(())
10242025-08-28T21:45:05.035ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10252025-08-28T21:45:05.035ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
10262025-08-28T21:45:05.037ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
10272025-08-28T21:45:05.038ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = ConsoleSession { parent: Fleet, key: 81a01eda-ac4b-404c-98bb-3e70c031d0d6 (console_session), lookup_type: ById(81a01eda-ac4b-404c-98bb-3e70c031d0d6) } result = Ok(())
10282025-08-28T21:45:05.038ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10292025-08-28T21:45:05.038ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
10302025-08-28T21:45:05.041ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10312025-08-28T21:45:05.042ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
10322025-08-28T21:45:05.043ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10332025-08-28T21:45:05.043ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
10342025-08-28T21:45:05.044ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10352025-08-28T21:45:05.045ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
10362025-08-28T21:45:05.046ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10372025-08-28T21:45:05.046ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
10382025-08-28T21:45:05.047ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
10392025-08-28T21:45:05.049ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), lookup_type: ById(d39666d5-c52f-4734-9b61-e44c37604a64) } result = Ok(())
10402025-08-28T21:45:05.049ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10412025-08-28T21:45:05.049ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
10422025-08-28T21:45:05.050ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10432025-08-28T21:45:05.050ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
10442025-08-28T21:45:05.051ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10452025-08-28T21:45:05.051ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
10462025-08-28T21:45:05.053ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
10472025-08-28T21:45:05.054ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) } result = Ok(())
10482025-08-28T21:45:05.054ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10492025-08-28T21:45:05.054ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10502025-08-28T21:45:05.055ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10512025-08-28T21:45:05.056ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10522025-08-28T21:45:05.057ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10532025-08-28T21:45:05.057ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10542025-08-28T21:45:05.059ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10552025-08-28T21:45:05.059ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10562025-08-28T21:45:05.061ZINFOnexus (BackgroundTasks): VPC route manager sled af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
10572025-08-28T21:45:05.061ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
10582025-08-28T21:45:05.061ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10592025-08-28T21:45:05.062ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ed3766b-2c9c-4fe7-aa30-c042cb7a3eba", "content-length": "372", "date": "Thu, 28 Aug 2025 21:45:04 GMT"} })
10602025-08-28T21:45:05.062ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10612025-08-28T21:45:05.062ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10622025-08-28T21:45:05.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10632025-08-28T21:45:05.064ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10642025-08-28T21:45:05.064ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10652025-08-28T21:45:05.066ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10662025-08-28T21:45:05.067ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10672025-08-28T21:45:05.068ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {(Silo, 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, "admin")} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10682025-08-28T21:45:05.072ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: 9a9c1a75-9cd1-4e13-a807-276e1ce5e24f, lookup_type: ByName("proj-e359e85c650") }, key: de791e81-9102-48fa-a5bf-0e900af5e450, lookup_type: ByName("default") } result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10692025-08-28T21:45:05.072ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10702025-08-28T21:45:05.072ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10712025-08-28T21:45:05.075ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10722025-08-28T21:45:05.075ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10732025-08-28T21:45:05.076ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
10742025-08-28T21:45:05.076ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
10752025-08-28T21:45:05.076ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d71a0667-07c0-4810-b93b-20a336066e22", "date": "Thu, 28 Aug 2025 21:45:04 GMT"} })
10762025-08-28T21:45:05.076ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10772025-08-28T21:45:05.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10782025-08-28T21:45:05.077ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10792025-08-28T21:45:05.077ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10802025-08-28T21:45:05.078ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10812025-08-28T21:45:05.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10822025-08-28T21:45:05.079ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10832025-08-28T21:45:05.080ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10842025-08-28T21:45:05.080ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10852025-08-28T21:45:05.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10862025-08-28T21:45:05.082ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {(Silo, 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, "admin")} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10872025-08-28T21:45:05.083ZINFOnexus (BackgroundTasks): VPC route manager sled af8277ed-838c-4274-8629-14eae35fd0e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
10882025-08-28T21:45:05.083ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
10892025-08-28T21:45:05.083ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "69d61c6b-2c7c-4da1-82e1-522caf78da1d", "date": "Thu, 28 Aug 2025 21:45:04 GMT"} })
10902025-08-28T21:45:05.085ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 64.412541ms iteration = 29 status = {}
10912025-08-28T21:45:05.085ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: 9a9c1a75-9cd1-4e13-a807-276e1ce5e24f, lookup_type: ByName("proj-e359e85c650") }, key: de791e81-9102-48fa-a5bf-0e900af5e450, lookup_type: ByName("default") } result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10922025-08-28T21:45:05.085ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10932025-08-28T21:45:05.085ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10942025-08-28T21:45:05.087ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10952025-08-28T21:45:05.087ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10962025-08-28T21:45:05.091ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10972025-08-28T21:45:05.091ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10982025-08-28T21:45:05.093ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
10992025-08-28T21:45:05.093ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
11002025-08-28T21:45:05.095ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
11012025-08-28T21:45:05.095ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
11022025-08-28T21:45:05.097ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
11032025-08-28T21:45:05.098ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
11042025-08-28T21:45:05.100ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {(Silo, 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, "admin")} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
11052025-08-28T21:45:05.104ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: 9a9c1a75-9cd1-4e13-a807-276e1ce5e24f, lookup_type: ByName("proj-e359e85c650") }, key: de791e81-9102-48fa-a5bf-0e900af5e450, lookup_type: ByName("default") }, key: 9d91695a-7195-40a4-9380-88ffaebe8f9c, lookup_type: ById(9d91695a-7195-40a4-9380-88ffaebe8f9c) } result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
11062025-08-28T21:45:05.104ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
11072025-08-28T21:45:05.104ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
11082025-08-28T21:45:05.108ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
11092025-08-28T21:45:05.108ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
11102025-08-28T21:45:05.112ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
11112025-08-28T21:45:05.112ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
11122025-08-28T21:45:05.114ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
11132025-08-28T21:45:05.114ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
11142025-08-28T21:45:05.117ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
11152025-08-28T21:45:05.117ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
11162025-08-28T21:45:05.119ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
11172025-08-28T21:45:05.119ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
11182025-08-28T21:45:05.122ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
11192025-08-28T21:45:05.122ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
11202025-08-28T21:45:05.124ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {(Silo, 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, "admin")} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
11212025-08-28T21:45:05.127ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: 9a9c1a75-9cd1-4e13-a807-276e1ce5e24f, lookup_type: ByName("proj-e359e85c650") }, key: de791e81-9102-48fa-a5bf-0e900af5e450, lookup_type: ByName("default") } result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
11222025-08-28T21:45:05.127ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
11232025-08-28T21:45:05.127ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/vpcs/default?project=proj-e359e85c650
11242025-08-28T21:45:05.131ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 109747 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = f510a086-bbbb-4e9e-8c31-840b58609db6 response_code = 204 uri = /v1/vpcs/default?project=proj-e359e85c650
11252025-08-28T21:45:05.132ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11262025-08-28T21:45:05.132ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
11272025-08-28T21:45:05.134ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11282025-08-28T21:45:05.134ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
11292025-08-28T21:45:05.135ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
11302025-08-28T21:45:05.137ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = ConsoleSession { parent: Fleet, key: 81a01eda-ac4b-404c-98bb-3e70c031d0d6 (console_session), lookup_type: ById(81a01eda-ac4b-404c-98bb-3e70c031d0d6) } result = Ok(())
11312025-08-28T21:45:05.137ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11322025-08-28T21:45:05.137ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
11332025-08-28T21:45:05.138ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11342025-08-28T21:45:05.139ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
11352025-08-28T21:45:05.140ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11362025-08-28T21:45:05.140ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
11372025-08-28T21:45:05.141ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11382025-08-28T21:45:05.141ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
11392025-08-28T21:45:05.143ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
11402025-08-28T21:45:05.144ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), lookup_type: ById(d39666d5-c52f-4734-9b61-e44c37604a64) } result = Ok(())
11412025-08-28T21:45:05.144ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11422025-08-28T21:45:05.144ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
11432025-08-28T21:45:05.145ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
11442025-08-28T21:45:05.147ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = ConsoleSession { parent: Fleet, key: 81a01eda-ac4b-404c-98bb-3e70c031d0d6 (console_session), lookup_type: ById(81a01eda-ac4b-404c-98bb-3e70c031d0d6) } result = Ok(())
11452025-08-28T21:45:05.147ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11462025-08-28T21:45:05.147ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
11472025-08-28T21:45:05.151ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11482025-08-28T21:45:05.151ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
11492025-08-28T21:45:05.152ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11502025-08-28T21:45:05.152ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
11512025-08-28T21:45:05.154ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11522025-08-28T21:45:05.154ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
11532025-08-28T21:45:05.155ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11542025-08-28T21:45:05.155ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
11552025-08-28T21:45:05.156ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
11562025-08-28T21:45:05.158ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), lookup_type: ById(d39666d5-c52f-4734-9b61-e44c37604a64) } result = Ok(())
11572025-08-28T21:45:05.158ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11582025-08-28T21:45:05.158ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
11592025-08-28T21:45:05.159ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11602025-08-28T21:45:05.159ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
11612025-08-28T21:45:05.160ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11622025-08-28T21:45:05.160ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
11632025-08-28T21:45:05.162ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
11642025-08-28T21:45:05.163ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) } result = Ok(())
11652025-08-28T21:45:05.163ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11662025-08-28T21:45:05.163ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11672025-08-28T21:45:05.166ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11682025-08-28T21:45:05.166ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11692025-08-28T21:45:05.168ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {(Silo, 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, "admin")} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11702025-08-28T21:45:05.169ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = AuditLog result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11712025-08-28T21:45:05.169ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11722025-08-28T21:45:05.169ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11732025-08-28T21:45:05.173ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11742025-08-28T21:45:05.173ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11752025-08-28T21:45:05.174ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11762025-08-28T21:45:05.175ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11772025-08-28T21:45:05.176ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11782025-08-28T21:45:05.176ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11792025-08-28T21:45:05.179ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11802025-08-28T21:45:05.179ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11812025-08-28T21:45:05.181ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11822025-08-28T21:45:05.181ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11832025-08-28T21:45:05.184ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11842025-08-28T21:45:05.184ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11852025-08-28T21:45:05.185ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {(Silo, 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, "admin")} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11862025-08-28T21:45:05.188ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = Project { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: 9a9c1a75-9cd1-4e13-a807-276e1ce5e24f, lookup_type: ByName("proj-e359e85c650") } result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11872025-08-28T21:45:05.188ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11882025-08-28T21:45:05.188ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11892025-08-28T21:45:05.190ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11902025-08-28T21:45:05.191ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11912025-08-28T21:45:05.193ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11922025-08-28T21:45:05.193ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11932025-08-28T21:45:05.195ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11942025-08-28T21:45:05.196ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11952025-08-28T21:45:05.198ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {(Silo, 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, "admin")} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11962025-08-28T21:45:05.200ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = Project { parent: Silo { parent: Fleet, key: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, lookup_type: ById(427aaf87-3d8a-4dc0-888f-bfc71eaeae3f) }, key: 9a9c1a75-9cd1-4e13-a807-276e1ce5e24f, lookup_type: ByName("proj-e359e85c650") } result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11972025-08-28T21:45:05.200ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11982025-08-28T21:45:05.200ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
11992025-08-28T21:45:05.202ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
12002025-08-28T21:45:05.203ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
12012025-08-28T21:45:05.205ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
12022025-08-28T21:45:05.205ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
12032025-08-28T21:45:05.213ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
12042025-08-28T21:45:05.213ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
12052025-08-28T21:45:05.219ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
12062025-08-28T21:45:05.219ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
12072025-08-28T21:45:05.220ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
12082025-08-28T21:45:05.221ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
12092025-08-28T21:45:05.223ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
12102025-08-28T21:45:05.223ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
12112025-08-28T21:45:05.225ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
12122025-08-28T21:45:05.225ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
12132025-08-28T21:45:05.227ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
12142025-08-28T21:45:05.227ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
12152025-08-28T21:45:05.235ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
12162025-08-28T21:45:05.235ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
12172025-08-28T21:45:05.238ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
12182025-08-28T21:45:05.238ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
12192025-08-28T21:45:05.240ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {(Silo, 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, "admin")} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
12202025-08-28T21:45:05.241ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = AuditLog result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
12212025-08-28T21:45:05.241ZDEBGnexus (dropshot_external): roles authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c roles = RoleSet { roles: {} } silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
12222025-08-28T21:45:05.241ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d39666d5-c52f-4734-9b61-e44c37604a64 (silo_user), silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, .. }) authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c resource = Database result = Ok(()) silo_id = 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f silo_user_id = d39666d5-c52f-4734-9b61-e44c37604a64 uri = /v1/projects/proj-e359e85c650
12232025-08-28T21:45:05.280ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 147851 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:37002 req_id = 333796ad-64cf-4928-b177-338ed955df7c response_code = 204 uri = /v1/projects/proj-e359e85c650
12242025-08-28T21:45:05.370ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 7a2345bc-9869-42c0-abbd-72ad99d11921 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
12252025-08-28T21:45:05.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 7a2345bc-9869-42c0-abbd-72ad99d11921 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
12262025-08-28T21:45:05.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 6493 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 7a2345bc-9869-42c0-abbd-72ad99d11921 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
12272025-08-28T21:45:06.391ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = adcf2a27-80e8-4cd1-a1d8-47d6df50dc75 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
12282025-08-28T21:45:06.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = adcf2a27-80e8-4cd1-a1d8-47d6df50dc75 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
12292025-08-28T21:45:06.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2587 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = adcf2a27-80e8-4cd1-a1d8-47d6df50dc75 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
12302025-08-28T21:45:07.408ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 8aac1a64-12a2-496b-a373-1a3e0b5581b5 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
12312025-08-28T21:45:07.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 8aac1a64-12a2-496b-a373-1a3e0b5581b5 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
12322025-08-28T21:45:07.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2654 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 8aac1a64-12a2-496b-a373-1a3e0b5581b5 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
12332025-08-28T21:45:07.446ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
12342025-08-28T21:45:07.446ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
12352025-08-28T21:45:07.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12362025-08-28T21:45:07.446ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 141 reason = Timeout
12372025-08-28T21:45:07.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12382025-08-28T21:45:07.446ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
12392025-08-28T21:45:07.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
12402025-08-28T21:45:07.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
12412025-08-28T21:45:07.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12422025-08-28T21:45:07.449ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12432025-08-28T21:45:07.449ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12442025-08-28T21:45:07.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12452025-08-28T21:45:07.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12462025-08-28T21:45:07.451ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.089452ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12472025-08-28T21:45:07.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12482025-08-28T21:45:07.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12492025-08-28T21:45:07.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
12502025-08-28T21:45:07.453ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
12512025-08-28T21:45:07.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
12522025-08-28T21:45:07.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
12532025-08-28T21:45:07.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12542025-08-28T21:45:07.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
12552025-08-28T21:45:07.455ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
12562025-08-28T21:45:07.455ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.750987ms iteration = 141 status = {"chicken_switches_updated":false}
12572025-08-28T21:45:07.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12582025-08-28T21:45:07.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 75210457-5921-4367-8327-1fd4d2d66bd6, lookup_type: ById(75210457-5921-4367-8327-1fd4d2d66bd6) } result = Ok(())
12592025-08-28T21:45:07.459ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12602025-08-28T21:45:07.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
12612025-08-28T21:45:07.477ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 original_time_created = 2025-08-28 21:33:17.370599 UTC target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 time_created = 2025-08-28 21:33:17.370599 UTC
12622025-08-28T21:45:07.477ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.681546ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"75210457-5921-4367-8327-1fd4d2d66bd6","time_created":"2025-08-28T21:33:17.370599Z"}
12632025-08-28T21:45:08.425ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 19549d4e-5b3b-4b0e-9663-115647450d02 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
12642025-08-28T21:45:08.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 19549d4e-5b3b-4b0e-9663-115647450d02 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
12652025-08-28T21:45:08.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2695 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 19549d4e-5b3b-4b0e-9663-115647450d02 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
12662025-08-28T21:45:09.441ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = a6a2c336-8ef3-4e00-a18a-b65f984ff893 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
12672025-08-28T21:45:09.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = a6a2c336-8ef3-4e00-a18a-b65f984ff893 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
12682025-08-28T21:45:09.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2374 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = a6a2c336-8ef3-4e00-a18a-b65f984ff893 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
12692025-08-28T21:45:09.894ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2891 local_addr = [fd00:1122:3344:101::a]:41821 method = GET remote_addr = [fd00:1122:3344:101::d]:45939 req_id = ea3ccfac-f990-4094-b2aa-1c9f0571633a response_code = 200 uri = /0fe4e55a-5967-4507-9554-6c41366055df
12702025-08-28T21:45:10.457ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = d60ede7c-dca1-4a27-8e5a-163a9a53b0d8 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
12712025-08-28T21:45:10.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = d60ede7c-dca1-4a27-8e5a-163a9a53b0d8 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
12722025-08-28T21:45:10.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2372 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = d60ede7c-dca1-4a27-8e5a-163a9a53b0d8 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
12732025-08-28T21:45:11.474ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = f0069400-924b-4fa2-ae8d-7136fd1b1d84 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
12742025-08-28T21:45:11.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = f0069400-924b-4fa2-ae8d-7136fd1b1d84 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
12752025-08-28T21:45:11.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2526 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = f0069400-924b-4fa2-ae8d-7136fd1b1d84 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
12762025-08-28T21:45:12.446ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 142 reason = Timeout
12772025-08-28T21:45:12.446ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
12782025-08-28T21:45:12.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
12792025-08-28T21:45:12.449ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12802025-08-28T21:45:12.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
12812025-08-28T21:45:12.452ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
12822025-08-28T21:45:12.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
12832025-08-28T21:45:12.454ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
12842025-08-28T21:45:12.454ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.397508ms iteration = 142 status = {"chicken_switches_updated":false}
12852025-08-28T21:45:12.490ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 57252ce1-ff87-45ab-b667-ef6dd4b5e1fa roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
12862025-08-28T21:45:12.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 57252ce1-ff87-45ab-b667-ef6dd4b5e1fa resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
12872025-08-28T21:45:12.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2339 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 57252ce1-ff87-45ab-b667-ef6dd4b5e1fa response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
12882025-08-28T21:45:13.505ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = ffbe7437-3938-435e-8bff-a522279c20e7 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
12892025-08-28T21:45:13.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = ffbe7437-3938-435e-8bff-a522279c20e7 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
12902025-08-28T21:45:13.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2499 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = ffbe7437-3938-435e-8bff-a522279c20e7 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
12912025-08-28T21:45:14.521ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 3a8acf59-c739-46a2-a26b-87d9ab9442ec roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
12922025-08-28T21:45:14.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 3a8acf59-c739-46a2-a26b-87d9ab9442ec resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
12932025-08-28T21:45:14.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2740 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 3a8acf59-c739-46a2-a26b-87d9ab9442ec response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
12942025-08-28T21:45:15.539ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = f76f11c1-cd55-4b7d-b563-8ee6c43b6985 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
12952025-08-28T21:45:15.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = f76f11c1-cd55-4b7d-b563-8ee6c43b6985 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
12962025-08-28T21:45:15.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2231 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = f76f11c1-cd55-4b7d-b563-8ee6c43b6985 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
12972025-08-28T21:45:16.554ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = ca055618-0ed6-479e-961f-e5905e68328a roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
12982025-08-28T21:45:16.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = ca055618-0ed6-479e-961f-e5905e68328a resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
12992025-08-28T21:45:16.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2976 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = ca055618-0ed6-479e-961f-e5905e68328a response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
13002025-08-28T21:45:17.446ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
13012025-08-28T21:45:17.446ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
13022025-08-28T21:45:17.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13032025-08-28T21:45:17.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13042025-08-28T21:45:17.446ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 143 reason = Timeout
13052025-08-28T21:45:17.446ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
13062025-08-28T21:45:17.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13072025-08-28T21:45:17.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
13082025-08-28T21:45:17.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
13092025-08-28T21:45:17.449ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13102025-08-28T21:45:17.449ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13112025-08-28T21:45:17.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13122025-08-28T21:45:17.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13132025-08-28T21:45:17.451ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.686912ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13142025-08-28T21:45:17.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
13152025-08-28T21:45:17.453ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
13162025-08-28T21:45:17.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13172025-08-28T21:45:17.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13182025-08-28T21:45:17.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
13192025-08-28T21:45:17.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
13202025-08-28T21:45:17.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13212025-08-28T21:45:17.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
13222025-08-28T21:45:17.455ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
13232025-08-28T21:45:17.455ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 9.228029ms iteration = 143 status = {"chicken_switches_updated":false}
13242025-08-28T21:45:17.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13252025-08-28T21:45:17.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 75210457-5921-4367-8327-1fd4d2d66bd6, lookup_type: ById(75210457-5921-4367-8327-1fd4d2d66bd6) } result = Ok(())
13262025-08-28T21:45:17.459ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13272025-08-28T21:45:17.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
13282025-08-28T21:45:17.474ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 original_time_created = 2025-08-28 21:33:17.370599 UTC target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 time_created = 2025-08-28 21:33:17.370599 UTC
13292025-08-28T21:45:17.474ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.935425ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"75210457-5921-4367-8327-1fd4d2d66bd6","time_created":"2025-08-28T21:33:17.370599Z"}
13302025-08-28T21:45:17.570ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = c51a84b8-a0a0-40a2-b9c4-617a0724c359 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
13312025-08-28T21:45:17.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = c51a84b8-a0a0-40a2-b9c4-617a0724c359 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
13322025-08-28T21:45:17.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 1956 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = c51a84b8-a0a0-40a2-b9c4-617a0724c359 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
13332025-08-28T21:45:18.586ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = e63e51b8-d321-4a2c-81ad-956434450d21 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
13342025-08-28T21:45:18.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = e63e51b8-d321-4a2c-81ad-956434450d21 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
13352025-08-28T21:45:18.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2860 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = e63e51b8-d321-4a2c-81ad-956434450d21 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
13362025-08-28T21:45:19.602ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = fa3c14fd-d0d7-446b-aec1-2dc932c9d50f roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
13372025-08-28T21:45:19.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = fa3c14fd-d0d7-446b-aec1-2dc932c9d50f resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
13382025-08-28T21:45:19.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2290 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = fa3c14fd-d0d7-446b-aec1-2dc932c9d50f response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
13392025-08-28T21:45:19.894ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2877 local_addr = [fd00:1122:3344:101::a]:41821 method = GET remote_addr = [fd00:1122:3344:101::d]:45939 req_id = ef7c4fde-5e7f-47c6-b703-7417275667b5 response_code = 200 uri = /0fe4e55a-5967-4507-9554-6c41366055df
13402025-08-28T21:45:20.617ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 143019bf-c434-4d1e-af7c-c28cd18d883e roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
13412025-08-28T21:45:20.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 143019bf-c434-4d1e-af7c-c28cd18d883e resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
13422025-08-28T21:45:20.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2452 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 143019bf-c434-4d1e-af7c-c28cd18d883e response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
13432025-08-28T21:45:21.633ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 832417a7-7807-446d-95a6-1d406b997744 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
13442025-08-28T21:45:21.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 832417a7-7807-446d-95a6-1d406b997744 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
13452025-08-28T21:45:21.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2611 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 832417a7-7807-446d-95a6-1d406b997744 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
13462025-08-28T21:45:22.446ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 144 reason = Timeout
13472025-08-28T21:45:22.446ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
13482025-08-28T21:45:22.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
13492025-08-28T21:45:22.449ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13502025-08-28T21:45:22.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
13512025-08-28T21:45:22.451ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
13522025-08-28T21:45:22.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
13532025-08-28T21:45:22.454ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
13542025-08-28T21:45:22.454ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.868364ms iteration = 144 status = {"chicken_switches_updated":false}
13552025-08-28T21:45:22.649ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = ed8fc147-2335-48cb-bf0e-737cb2863a38 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
13562025-08-28T21:45:22.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = ed8fc147-2335-48cb-bf0e-737cb2863a38 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
13572025-08-28T21:45:22.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2177 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = ed8fc147-2335-48cb-bf0e-737cb2863a38 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
13582025-08-28T21:45:23.664ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 03af72d1-1324-4477-91a2-cfe4577219e7 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
13592025-08-28T21:45:23.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 03af72d1-1324-4477-91a2-cfe4577219e7 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
13602025-08-28T21:45:23.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2673 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 03af72d1-1324-4477-91a2-cfe4577219e7 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
13612025-08-28T21:45:24.680ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 20adf302-f0d7-41b4-bc84-c28b4813e1d2 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
13622025-08-28T21:45:24.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 20adf302-f0d7-41b4-bc84-c28b4813e1d2 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
13632025-08-28T21:45:24.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2645 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 20adf302-f0d7-41b4-bc84-c28b4813e1d2 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
13642025-08-28T21:45:25.697ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 3aaf7adb-60ff-44ae-adc4-b9b62d80ab87 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
13652025-08-28T21:45:25.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 3aaf7adb-60ff-44ae-adc4-b9b62d80ab87 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
13662025-08-28T21:45:25.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2637 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 3aaf7adb-60ff-44ae-adc4-b9b62d80ab87 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
13672025-08-28T21:45:26.714ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = e3011e34-8ad1-4a61-9313-725af9a16fcf roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
13682025-08-28T21:45:26.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = e3011e34-8ad1-4a61-9313-725af9a16fcf resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
13692025-08-28T21:45:26.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2735 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = e3011e34-8ad1-4a61-9313-725af9a16fcf response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
13702025-08-28T21:45:27.314ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
13712025-08-28T21:45:27.314ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:91 reason = blueprint disabled target_id = 75210457-5921-4367-8327-1fd4d2d66bd6
13722025-08-28T21:45:27.314ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
13732025-08-28T21:45:27.314ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
13742025-08-28T21:45:27.314ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 41.701\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"75210457-5921-4367-8327-1fd4d2d66bd6"}
13752025-08-28T21:45:27.314ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
13762025-08-28T21:45:27.314ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13772025-08-28T21:45:27.314ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
13782025-08-28T21:45:27.314ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13792025-08-28T21:45:27.314ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
13802025-08-28T21:45:27.314ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-28 21:35:27.314240205 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
13812025-08-28T21:45:27.314ZDEBGnexus (BackgroundTasks): activating background_task = nat_garbage_collector iteration = 25 reason = Timeout
13822025-08-28T21:45:27.314ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
13832025-08-28T21:45:27.314ZDEBGnexus (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
13842025-08-28T21:45:27.314ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
13852025-08-28T21:45:27.314ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
13862025-08-28T21:45:27.314ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
13872025-08-28T21:45:27.314ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
13882025-08-28T21:45:27.314ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13892025-08-28T21:45:27.314ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
13902025-08-28T21:45:27.314ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
13912025-08-28T21:45:27.314ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13922025-08-28T21:45:27.314ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
13932025-08-28T21:45:27.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13942025-08-28T21:45:27.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13952025-08-28T21:45:27.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
13962025-08-28T21:45:27.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = bfd_manager resource = Database result = Ok(())
13972025-08-28T21:45:27.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
13982025-08-28T21:45:27.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
13992025-08-28T21:45:27.314ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("34926ba2-743e-40ae-813d-5f114d8a9912.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3683ed2f-b132-4612-ad98-adc9a748bc7e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e7031451-4fb4-459c-889a-f39ec3c49e88.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("e7031451-4fb4-459c-889a-f39ec3c49e88.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 1695, tv_nsec: 846389121 } })
14002025-08-28T21:45:27.315ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("29f5e375-8d13-490a-8d8c-25abbffb62fc.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f7509ee4-501a-451c-a026-2b7946c79d73.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f7509ee4-501a-451c-a026-2b7946c79d73.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1695, tv_nsec: 846506844 } })
14012025-08-28T21:45:27.315ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14022025-08-28T21:45:27.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14032025-08-28T21:45:27.315ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14042025-08-28T21:45:27.315ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
14052025-08-28T21:45:27.315ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.304344ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
14062025-08-28T21:45:27.315ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
14072025-08-28T21:45:27.315ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.313994ms iteration = 14 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
14082025-08-28T21:45:27.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14092025-08-28T21:45:27.316ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14102025-08-28T21:45:27.317ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14112025-08-28T21:45:27.317ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1695, tv_nsec: 849029119 } })
14122025-08-28T21:45:27.317ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14132025-08-28T21:45:27.317ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1695, tv_nsec: 849119932 } })
14142025-08-28T21:45:27.317ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-28 21:35:27.314240205 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
14152025-08-28T21:45:27.317ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.44221ms iteration = 13 status = {"expiration":"2025-08-28T21:35:27.314240205Z","pruned":[]}
14162025-08-28T21:45:27.317ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1205
14172025-08-28T21:45:27.317ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_garbage_collector file = nexus/src/app/mod.rs:1205
14182025-08-28T21:45:27.318ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.308562ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
14192025-08-28T21:45:27.319ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14202025-08-28T21:45:27.319ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14212025-08-28T21:45:27.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
14222025-08-28T21:45:27.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14232025-08-28T21:45:27.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
14242025-08-28T21:45:27.321ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14252025-08-28T21:45:27.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
14262025-08-28T21:45:27.322ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
14272025-08-28T21:45:27.322ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
14282025-08-28T21:45:27.322ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
14292025-08-28T21:45:27.322ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14302025-08-28T21:45:27.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14312025-08-28T21:45:27.323ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14322025-08-28T21:45:27.323ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14332025-08-28T21:45:27.327ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
14342025-08-28T21:45:27.327ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14352025-08-28T21:45:27.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
14362025-08-28T21:45:27.327ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14372025-08-28T21:45:27.327ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14382025-08-28T21:45:27.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14392025-08-28T21:45:27.329ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
14402025-08-28T21:45:27.329ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 18 reason = Timeout
14412025-08-28T21:45:27.329ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
14422025-08-28T21:45:27.329ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 8.1\u{b5}s iteration = 18 status = "Disabled"
14432025-08-28T21:45:27.329ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14442025-08-28T21:45:27.329ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
14452025-08-28T21:45:27.329ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
14462025-08-28T21:45:27.329ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14472025-08-28T21:45:27.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14482025-08-28T21:45:27.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14492025-08-28T21:45:27.329ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14502025-08-28T21:45:27.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14512025-08-28T21:45:27.330ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14522025-08-28T21:45:27.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14532025-08-28T21:45:27.330ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14542025-08-28T21:45:27.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14552025-08-28T21:45:27.330ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14562025-08-28T21:45:27.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14572025-08-28T21:45:27.331ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14582025-08-28T21:45:27.331ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14592025-08-28T21:45:27.333ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
14602025-08-28T21:45:27.333ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14612025-08-28T21:45:27.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14622025-08-28T21:45:27.334ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14632025-08-28T21:45:27.334ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14642025-08-28T21:45:27.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14652025-08-28T21:45:27.334ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14662025-08-28T21:45:27.336ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14672025-08-28T21:45:27.336ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14682025-08-28T21:45:27.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14692025-08-28T21:45:27.336ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14702025-08-28T21:45:27.338ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14712025-08-28T21:45:27.338ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14722025-08-28T21:45:27.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14732025-08-28T21:45:27.338ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14742025-08-28T21:45:27.340ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14752025-08-28T21:45:27.340ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14762025-08-28T21:45:27.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14772025-08-28T21:45:27.341ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
14782025-08-28T21:45:27.341ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
14792025-08-28T21:45:27.341ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
14802025-08-28T21:45:27.341ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
14812025-08-28T21:45:27.341ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
14822025-08-28T21:45:27.341ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
14832025-08-28T21:45:27.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = lookup_region_port resource = Database result = Ok(())
14842025-08-28T21:45:27.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
14852025-08-28T21:45:27.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database result = Ok(())
14862025-08-28T21:45:27.348ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 13 reason = Timeout
14872025-08-28T21:45:27.348ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
14882025-08-28T21:45:27.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = webhook_deliverator resource = Database result = Ok(())
14892025-08-28T21:45:27.348ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 13 reason = Timeout
14902025-08-28T21:45:27.348ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
14912025-08-28T21:45:27.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database result = Ok(())
14922025-08-28T21:45:27.349ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.635418ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
14932025-08-28T21:45:27.351ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
14942025-08-28T21:45:27.351ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 3.151632ms iteration = 13 status = {"by_rx":{},"error":null}
14952025-08-28T21:45:27.352ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
14962025-08-28T21:45:27.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database result = Ok(())
14972025-08-28T21:45:27.355ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 6.971601ms iteration = 13 status = {"dispatched":[],"errors":[],"glob_version":"183.0.0","globs_reprocessed":{},"no_receivers":[]}
14982025-08-28T21:45:27.370ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
14992025-08-28T21:45:27.370ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 00f179d2-0574-4e49-85ff-8736d21b9fd1 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
15002025-08-28T21:45:27.370ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15012025-08-28T21:45:27.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15022025-08-28T21:45:27.371ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
15032025-08-28T21:45:27.371ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
15042025-08-28T21:45:27.371ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
15052025-08-28T21:45:27.371ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15062025-08-28T21:45:27.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15072025-08-28T21:45:27.372ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15082025-08-28T21:45:27.375ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15092025-08-28T21:45:27.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
15102025-08-28T21:45:27.375ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15112025-08-28T21:45:27.375ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15122025-08-28T21:45:27.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15132025-08-28T21:45:27.377ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15142025-08-28T21:45:27.378ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 00f179d2-0574-4e49-85ff-8736d21b9fd1 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
15152025-08-28T21:45:27.378ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
15162025-08-28T21:45:27.378ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-28 21:34:04.777048 UTC dns_group = internal generation = 1
15172025-08-28T21:45:27.378ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 64.740169ms iteration = 14 status = {"generation":1}
15182025-08-28T21:45:27.379ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
15192025-08-28T21:45:27.379ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15202025-08-28T21:45:27.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
15212025-08-28T21:45:27.382ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15222025-08-28T21:45:27.384ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15232025-08-28T21:45:27.384ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15242025-08-28T21:45:27.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15252025-08-28T21:45:27.386ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
15262025-08-28T21:45:27.386ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
15272025-08-28T21:45:27.386ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 56.461364ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
15282025-08-28T21:45:27.386ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 56.923627ms iteration = 6 status = {"nsuccess":5}
15292025-08-28T21:45:27.396ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
15302025-08-28T21:45:27.396ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
15312025-08-28T21:45:27.396ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 55.069219ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
15322025-08-28T21:45:27.419ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15332025-08-28T21:45:27.422ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15342025-08-28T21:45:27.422ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15352025-08-28T21:45:27.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15362025-08-28T21:45:27.425ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
15372025-08-28T21:45:27.425ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
15382025-08-28T21:45:27.425ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = be33e1d0-e98d-462e-bd25-7cffb75dab02 dns_zone_name = oxide.test found_so_far = 0 version = 2
15392025-08-28T21:45:27.425ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15402025-08-28T21:45:27.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15412025-08-28T21:45:27.425ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1213 zone_address = fd00:1122:3344:101::2
15422025-08-28T21:45:27.425ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15432025-08-28T21:45:27.426ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "52bbd1df-c7c8-4549-911d-301f6733082c", "content-length": "26", "date": "Thu, 28 Aug 2025 21:45:27 GMT"} })
15442025-08-28T21:45:27.426ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1216 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15452025-08-28T21:45:27.426ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
15462025-08-28T21:45:27.427ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15472025-08-28T21:45:27.428ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1250 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15482025-08-28T21:45:27.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15492025-08-28T21:45:27.430ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15502025-08-28T21:45:27.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15512025-08-28T21:45:27.430ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-28T21:33:21.286055Z, time_modified: 2025-08-28T21:33:21.286055Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, db_silo: Silo { identity: SiloIdentity { id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-28T21:34:05.369976Z, time_modified: 2025-08-28T21:34:05.369976Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b6acf240eb452c21e0b1e580a1d52c2797fabc391b3eb746647244649b18e959" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, db_silo: Silo { identity: SiloIdentity { id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-28T21:34:05.369976Z, time_modified: 2025-08-28T21:34:05.369976Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b6acf240eb452c21e0b1e580a1d52c2797fabc391b3eb746647244649b18e959" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
15522025-08-28T21:45:27.430ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 116.632216ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"427aaf87-3d8a-4dc0-888f-bfc71eaeae3f","tls_certs":["b6acf240eb452c21e0b1e580a1d52c2797fabc391b3eb746647244649b18e959"]}},"default_endpoint":{"silo_id":"427aaf87-3d8a-4dc0-888f-bfc71eaeae3f","tls_certs":["b6acf240eb452c21e0b1e580a1d52c2797fabc391b3eb746647244649b18e959"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
15532025-08-28T21:45:27.432ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = be33e1d0-e98d-462e-bd25-7cffb75dab02 dns_zone_name = oxide.test found_so_far = 4 version = 2
15542025-08-28T21:45:27.432ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
15552025-08-28T21:45:27.432ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-28 21:34:05.486436 UTC dns_group = external generation = 2
15562025-08-28T21:45:27.432ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 118.165185ms iteration = 14 status = {"generation":2}
15572025-08-28T21:45:27.432ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_garbage_collector file = nexus/src/app/mod.rs:1213 zone_address = fd00:1122:3344:101::2
15582025-08-28T21:45:27.432ZDEBGnexus (MgsClient): client request background_task = nat_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15592025-08-28T21:45:27.433ZDEBGnexus (MgsClient): client response background_task = nat_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "04794972-dfd5-44fc-9711-0ea771b24e2f", "content-length": "26", "date": "Thu, 28 Aug 2025 21:45:26 GMT"} })
15602025-08-28T21:45:27.433ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_garbage_collector file = nexus/src/app/mod.rs:1216 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15612025-08-28T21:45:27.434ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_garbage_collector file = nexus/src/app/mod.rs:1250 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15622025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 25 reason = Timeout
15632025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
15642025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 18.381\u{b5}s iteration = 25 status = {"disabled":true,"errors":[],"sps":[]}
15652025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
15662025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
15672025-08-28T21:45:27.446ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
15682025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15692025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15702025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15712025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
15722025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15732025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
15742025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
15752025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15762025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
15772025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15782025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 25 reason = Timeout
15792025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
15802025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
15812025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15822025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
15832025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
15842025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
15852025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
15862025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15872025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
15882025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15892025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15902025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
15912025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15922025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 25 reason = Timeout
15932025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
15942025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 145 reason = Timeout
15952025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
15962025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
15972025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
15982025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
15992025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16002025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16012025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16022025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
16032025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
16042025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16052025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
16062025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16072025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
16082025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
16092025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
16102025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16112025-08-28T21:45:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
16122025-08-28T21:45:27.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16132025-08-28T21:45:27.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
16142025-08-28T21:45:27.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16152025-08-28T21:45:27.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
16162025-08-28T21:45:27.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
16172025-08-28T21:45:27.449ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16182025-08-28T21:45:27.449ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16192025-08-28T21:45:27.449ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16202025-08-28T21:45:27.449ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16212025-08-28T21:45:27.451ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16222025-08-28T21:45:27.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
16232025-08-28T21:45:27.454ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 7.71189ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16242025-08-28T21:45:27.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Fleet result = Ok(())
16252025-08-28T21:45:27.455ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16262025-08-28T21:45:27.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
16272025-08-28T21:45:27.455ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
16282025-08-28T21:45:27.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
16292025-08-28T21:45:27.456ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16302025-08-28T21:45:27.456ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16312025-08-28T21:45:27.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
16322025-08-28T21:45:27.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
16332025-08-28T21:45:27.456ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16342025-08-28T21:45:27.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16352025-08-28T21:45:27.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16362025-08-28T21:45:27.458ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
16372025-08-28T21:45:27.458ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 11.223351ms iteration = 145 status = {"chicken_switches_updated":false}
16382025-08-28T21:45:27.458ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16392025-08-28T21:45:27.459ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16402025-08-28T21:45:27.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16412025-08-28T21:45:27.462ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16422025-08-28T21:45:27.462ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16432025-08-28T21:45:27.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16442025-08-28T21:45:27.485ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
16452025-08-28T21:45:27.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database result = Ok(())
16462025-08-28T21:45:27.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16472025-08-28T21:45:27.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16482025-08-28T21:45:27.531ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16492025-08-28T21:45:27.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16502025-08-28T21:45:27.535ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 89.512822ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
16512025-08-28T21:45:27.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
16522025-08-28T21:45:27.536ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16532025-08-28T21:45:27.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16542025-08-28T21:45:27.537ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 91.163045ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
16552025-08-28T21:45:27.541ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16562025-08-28T21:45:27.541ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1696, tv_nsec: 73127562 } })
16572025-08-28T21:45:27.542ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1205 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1
16582025-08-28T21:45:27.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16592025-08-28T21:45:27.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16602025-08-28T21:45:27.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
16612025-08-28T21:45:27.545ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16622025-08-28T21:45:27.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
16632025-08-28T21:45:27.546ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
16642025-08-28T21:45:27.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
16652025-08-28T21:45:27.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16662025-08-28T21:45:27.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16672025-08-28T21:45:27.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
16682025-08-28T21:45:27.548ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16692025-08-28T21:45:27.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16702025-08-28T21:45:27.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16712025-08-28T21:45:27.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 75210457-5921-4367-8327-1fd4d2d66bd6, lookup_type: ById(75210457-5921-4367-8327-1fd4d2d66bd6) } result = Ok(())
16722025-08-28T21:45:27.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16732025-08-28T21:45:27.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
16742025-08-28T21:45:27.574ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16752025-08-28T21:45:27.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16762025-08-28T21:45:27.578ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16772025-08-28T21:45:27.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16782025-08-28T21:45:27.595ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16792025-08-28T21:45:27.595ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 149.19436ms iteration = 25 status = {"errors":[],"requests_created_ok":[]}
16802025-08-28T21:45:27.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16812025-08-28T21:45:27.596ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16822025-08-28T21:45:27.596ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
16832025-08-28T21:45:27.596ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16842025-08-28T21:45:27.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
16852025-08-28T21:45:27.598ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16862025-08-28T21:45:27.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16872025-08-28T21:45:27.602ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16882025-08-28T21:45:27.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16892025-08-28T21:45:27.609ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
16902025-08-28T21:45:27.609ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 163.314796ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
16912025-08-28T21:45:27.613ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16922025-08-28T21:45:27.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16932025-08-28T21:45:27.626ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 original_time_created = 2025-08-28 21:33:17.370599 UTC target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 time_created = 2025-08-28 21:33:17.370599 UTC
16942025-08-28T21:45:27.626ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 180.008579ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"75210457-5921-4367-8327-1fd4d2d66bd6","time_created":"2025-08-28T21:33:17.370599Z"}
16952025-08-28T21:45:27.627ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16962025-08-28T21:45:27.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16972025-08-28T21:45:27.631ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16982025-08-28T21:45:27.634ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 188.079009ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16992025-08-28T21:45:27.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: af8277ed-838c-4274-8629-14eae35fd0e4, lookup_type: ById(af8277ed-838c-4274-8629-14eae35fd0e4) } result = Ok(())
17002025-08-28T21:45:27.637ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17012025-08-28T21:45:27.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17022025-08-28T21:45:27.643ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 196.771083ms iteration = 25 status = 0
17032025-08-28T21:45:27.643ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17042025-08-28T21:45:27.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
17052025-08-28T21:45:27.646ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17062025-08-28T21:45:27.650ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
17072025-08-28T21:45:27.650ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17082025-08-28T21:45:27.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
17092025-08-28T21:45:27.663ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
17102025-08-28T21:45:27.663ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 321.812698ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
17112025-08-28T21:45:27.671ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 225.232312ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
17122025-08-28T21:45:27.680ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17132025-08-28T21:45:27.680ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
17142025-08-28T21:45:27.680ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17152025-08-28T21:45:27.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
17162025-08-28T21:45:27.682ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1213 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 zone_address = fd00:1122:3344:101::2
17172025-08-28T21:45:27.682ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17182025-08-28T21:45:27.683ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "718205ea-8950-46d0-b436-f930dde0a192", "content-length": "26", "date": "Thu, 28 Aug 2025 21:45:27 GMT"} })
17192025-08-28T21:45:27.683ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1216 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17202025-08-28T21:45:27.683ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17212025-08-28T21:45:27.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17222025-08-28T21:45:27.685ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1250 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1
17232025-08-28T21:45:27.719ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
17242025-08-28T21:45:27.720ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "aa3e54a2-c454-4b7e-88d6-7dbeacf6a3a6", "date": "Thu, 28 Aug 2025 21:45:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17252025-08-28T21:45:27.720ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17262025-08-28T21:45:27.722ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 407.789097ms iteration = 25 status = {}
17272025-08-28T21:45:27.723ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "7719df8a-c412-4500-995a-ef82b7f1b882", "date": "Thu, 28 Aug 2025 21:45:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17282025-08-28T21:45:27.723ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17292025-08-28T21:45:27.725ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17302025-08-28T21:45:27.725ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 410.845026ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
17312025-08-28T21:45:27.730ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 0c00f2f1-2f9d-40c8-a8bd-edeacdd06657 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
17322025-08-28T21:45:27.730ZDEBGnexus (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
17332025-08-28T21:45:27.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
17342025-08-28T21:45:27.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 0c00f2f1-2f9d-40c8-a8bd-edeacdd06657 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
17352025-08-28T21:45:27.733ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_garbage_collector elapsed = 419.023978ms iteration = 25 status = null
17362025-08-28T21:45:27.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 3815 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 0c00f2f1-2f9d-40c8-a8bd-edeacdd06657 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
17372025-08-28T21:45:27.742ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17382025-08-28T21:45:27.742ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
17392025-08-28T21:45:27.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
17402025-08-28T21:45:27.745ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
17412025-08-28T21:45:27.745ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 299.223102ms iteration = 25 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
17422025-08-28T21:45:27.747ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17432025-08-28T21:45:27.747ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
17442025-08-28T21:45:27.747ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 300.986858ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
17452025-08-28T21:45:27.754ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 307.840474ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
17462025-08-28T21:45:27.800ZINFOnexus (BackgroundTasks): VPC route manager sled af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
17472025-08-28T21:45:27.800ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17482025-08-28T21:45:27.800ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "efc66afe-4e19-4f23-95b2-3d46f2119d10", "content-length": "372", "date": "Thu, 28 Aug 2025 21:45:27 GMT"} })
17492025-08-28T21:45:27.800ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17502025-08-28T21:45:27.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17512025-08-28T21:45:27.815ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 369.245168ms iteration = 29 status = {"physical_disks_added":0}
17522025-08-28T21:45:27.819ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
17532025-08-28T21:45:27.819ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
17542025-08-28T21:45:27.819ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "214b084a-5a38-4f01-b57c-7cccaa4a29e7", "date": "Thu, 28 Aug 2025 21:45:27 GMT"} })
17552025-08-28T21:45:27.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17562025-08-28T21:45:27.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17572025-08-28T21:45:27.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17582025-08-28T21:45:27.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17592025-08-28T21:45:27.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17602025-08-28T21:45:27.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17612025-08-28T21:45:27.829ZINFOnexus (BackgroundTasks): VPC route manager sled af8277ed-838c-4274-8629-14eae35fd0e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
17622025-08-28T21:45:27.829ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17632025-08-28T21:45:27.829ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d07a758a-8621-437d-a495-53f2d887586e", "date": "Thu, 28 Aug 2025 21:45:27 GMT"} })
17642025-08-28T21:45:27.830ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
17652025-08-28T21:45:27.831ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a4d1728b-0ea3-404d-9585-50ef11a0cc3f", "date": "Thu, 28 Aug 2025 21:45:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
17662025-08-28T21:45:27.831ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
17672025-08-28T21:45:27.831ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 385.315204ms iteration = 30 status = {}
17682025-08-28T21:45:27.835ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ca4a756e-e408-4d26-9cc6-63999af1497a", "date": "Thu, 28 Aug 2025 21:45:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
17692025-08-28T21:45:27.835ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
17702025-08-28T21:45:27.837ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "4784fda2-91d4-4fb2-9cfa-d78c8561cd66", "date": "Thu, 28 Aug 2025 21:45:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
17712025-08-28T21:45:27.837ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
17722025-08-28T21:45:27.839ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
17732025-08-28T21:45:27.839ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 525.380608ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
17742025-08-28T21:45:27.877ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17752025-08-28T21:45:27.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17762025-08-28T21:45:27.880ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 00cfe4f2-9fed-42f3-bd7c-dbdf1ed57d5e, rack_id: 8a92b2f1-f565-4a24-a10f-f55b1f446cc1, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(c2e57029-848b-4db2-bb2f-4a9b47d7bf41) } rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 switch_location = Switch0
17772025-08-28T21:45:27.880ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17782025-08-28T21:45:27.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17792025-08-28T21:45:27.893ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17802025-08-28T21:45:27.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
17812025-08-28T21:45:27.894ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
17822025-08-28T21:45:27.894ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = c2e57029-848b-4db2-bb2f-4a9b47d7bf41
17832025-08-28T21:45:27.894ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
17842025-08-28T21:45:27.895ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
17852025-08-28T21:45:27.895ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17862025-08-28T21:45:27.895ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17872025-08-28T21:45:27.895ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17882025-08-28T21:45:27.895ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17892025-08-28T21:45:27.895ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17902025-08-28T21:45:27.895ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17912025-08-28T21:45:27.895ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1
17922025-08-28T21:45:27.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17932025-08-28T21:45:27.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17942025-08-28T21:45:27.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17952025-08-28T21:45:27.897ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 switch_location = Switch0
17962025-08-28T21:45:27.897ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
17972025-08-28T21:45:27.899ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17982025-08-28T21:45:27.899ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17992025-08-28T21:45:27.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
18002025-08-28T21:45:27.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18012025-08-28T21:45:27.903ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18022025-08-28T21:45:27.903ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18032025-08-28T21:45:27.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
18042025-08-28T21:45:27.937ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
18052025-08-28T21:45:27.938ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "01d96276-dc41-4c19-99e3-ccecfc699063", "content-length": "691", "date": "Thu, 28 Aug 2025 21:45:27 GMT"} })
18062025-08-28T21:45:27.938ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
18072025-08-28T21:45:27.938ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
18082025-08-28T21:45:27.938ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
18092025-08-28T21:45:27.940ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 493.865561ms iteration = 28 status = {}
18102025-08-28T21:45:28.011ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "894e1b5d-4b49-46bd-883e-a82330a92649", "date": "Thu, 28 Aug 2025 21:45:27 GMT"} })
18112025-08-28T21:45:28.011ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 switch = Switch0
18122025-08-28T21:45:28.011ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
18132025-08-28T21:45:28.012ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2de60d29-3bc5-4776-87b7-1e43b620a640", "content-length": "682", "date": "Thu, 28 Aug 2025 21:45:27 GMT"} })
18142025-08-28T21:45:28.012ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18152025-08-28T21:45:28.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18162025-08-28T21:45:28.016ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18172025-08-28T21:45:28.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18182025-08-28T21:45:28.020ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18192025-08-28T21:45:28.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18202025-08-28T21:45:28.022ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18212025-08-28T21:45:28.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18222025-08-28T21:45:28.029ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 583.652239ms iteration = 25 status = {}
18232025-08-28T21:45:28.751ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 83f841e2-db9b-4aac-8158-ede59a4e1986 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
18242025-08-28T21:45:28.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 83f841e2-db9b-4aac-8158-ede59a4e1986 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
18252025-08-28T21:45:28.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2676 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 83f841e2-db9b-4aac-8158-ede59a4e1986 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
18262025-08-28T21:45:29.767ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 286afc33-05bb-4fd5-9050-bff58e177d39 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
18272025-08-28T21:45:29.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 286afc33-05bb-4fd5-9050-bff58e177d39 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
18282025-08-28T21:45:29.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2596 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 286afc33-05bb-4fd5-9050-bff58e177d39 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
18292025-08-28T21:45:29.893ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2471 local_addr = [fd00:1122:3344:101::a]:41821 method = GET remote_addr = [fd00:1122:3344:101::d]:45939 req_id = 844778ca-3c01-42bc-9274-7b57d69f7877 response_code = 200 uri = /0fe4e55a-5967-4507-9554-6c41366055df
18302025-08-28T21:45:30.783ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 5b855f9e-55ea-4aed-92ff-b76a3082cbab roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
18312025-08-28T21:45:30.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 5b855f9e-55ea-4aed-92ff-b76a3082cbab resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
18322025-08-28T21:45:30.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 1937 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 5b855f9e-55ea-4aed-92ff-b76a3082cbab response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
18332025-08-28T21:45:31.799ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = c917cf6f-bc3e-4364-aa86-ec281bfc47b4 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
18342025-08-28T21:45:31.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = c917cf6f-bc3e-4364-aa86-ec281bfc47b4 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
18352025-08-28T21:45:31.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2786 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = c917cf6f-bc3e-4364-aa86-ec281bfc47b4 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
18362025-08-28T21:45:32.446ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 146 reason = Timeout
18372025-08-28T21:45:32.446ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
18382025-08-28T21:45:32.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
18392025-08-28T21:45:32.448ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18402025-08-28T21:45:32.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
18412025-08-28T21:45:32.451ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
18422025-08-28T21:45:32.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
18432025-08-28T21:45:32.453ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
18442025-08-28T21:45:32.453ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.645059ms iteration = 146 status = {"chicken_switches_updated":false}
18452025-08-28T21:45:32.815ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6aff564e-a35f-417e-ae18-61e40713231b roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
18462025-08-28T21:45:32.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6aff564e-a35f-417e-ae18-61e40713231b resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
18472025-08-28T21:45:32.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2392 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6aff564e-a35f-417e-ae18-61e40713231b response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
18482025-08-28T21:45:33.831ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 0ba5304a-9cd2-4fad-8857-fe94037a836c roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
18492025-08-28T21:45:33.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 0ba5304a-9cd2-4fad-8857-fe94037a836c resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
18502025-08-28T21:45:33.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2005 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 0ba5304a-9cd2-4fad-8857-fe94037a836c response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
18512025-08-28T21:45:34.514ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::2]:46077
18522025-08-28T21:45:34.514ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46077 req_id = 56bbbf94-0c55-4c36-bfe1-a5b43cd82225 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100 user_builtin_id = 001de000-05e4-4000-8000-000000000002
18532025-08-28T21:45:34.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46077 req_id = 56bbbf94-0c55-4c36-bfe1-a5b43cd82225 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100 user_builtin_id = 001de000-05e4-4000-8000-000000000002
18542025-08-28T21:45:34.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 3347 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46077 req_id = 56bbbf94-0c55-4c36-bfe1-a5b43cd82225 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
18552025-08-28T21:45:34.846ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = e5a07446-b293-434d-8c1a-b590320cd922 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
18562025-08-28T21:45:34.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = e5a07446-b293-434d-8c1a-b590320cd922 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
18572025-08-28T21:45:34.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2715 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = e5a07446-b293-434d-8c1a-b590320cd922 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
18582025-08-28T21:45:35.863ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = de5852c4-a155-4abf-bc32-7dbac6509a20 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
18592025-08-28T21:45:35.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = de5852c4-a155-4abf-bc32-7dbac6509a20 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
18602025-08-28T21:45:35.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2490 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = de5852c4-a155-4abf-bc32-7dbac6509a20 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
18612025-08-28T21:45:36.879ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 45bb3cc4-1300-4975-a103-08e853285520 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
18622025-08-28T21:45:36.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 45bb3cc4-1300-4975-a103-08e853285520 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
18632025-08-28T21:45:36.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2684 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 45bb3cc4-1300-4975-a103-08e853285520 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
18642025-08-28T21:45:37.446ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
18652025-08-28T21:45:37.446ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
18662025-08-28T21:45:37.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18672025-08-28T21:45:37.446ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 147 reason = Timeout
18682025-08-28T21:45:37.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18692025-08-28T21:45:37.446ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
18702025-08-28T21:45:37.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
18712025-08-28T21:45:37.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
18722025-08-28T21:45:37.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18732025-08-28T21:45:37.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18742025-08-28T21:45:37.449ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18752025-08-28T21:45:37.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18762025-08-28T21:45:37.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18772025-08-28T21:45:37.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
18782025-08-28T21:45:37.452ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
18792025-08-28T21:45:37.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
18802025-08-28T21:45:37.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
18812025-08-28T21:45:37.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18822025-08-28T21:45:37.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
18832025-08-28T21:45:37.454ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
18842025-08-28T21:45:37.454ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.999118ms iteration = 147 status = {"chicken_switches_updated":false}
18852025-08-28T21:45:37.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18862025-08-28T21:45:37.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 75210457-5921-4367-8327-1fd4d2d66bd6, lookup_type: ById(75210457-5921-4367-8327-1fd4d2d66bd6) } result = Ok(())
18872025-08-28T21:45:37.458ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18882025-08-28T21:45:37.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
18892025-08-28T21:45:37.482ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 original_time_created = 2025-08-28 21:33:17.370599 UTC target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 time_created = 2025-08-28 21:33:17.370599 UTC
18902025-08-28T21:45:37.482ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 35.827749ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"75210457-5921-4367-8327-1fd4d2d66bd6","time_created":"2025-08-28T21:33:17.370599Z"}
18912025-08-28T21:45:37.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18922025-08-28T21:45:37.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18932025-08-28T21:45:37.490ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 43.716474ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18942025-08-28T21:45:37.895ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 0d0cdc03-a46f-4ab1-8ff5-f92f990f5a91 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
18952025-08-28T21:45:37.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 0d0cdc03-a46f-4ab1-8ff5-f92f990f5a91 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
18962025-08-28T21:45:37.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2672 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 0d0cdc03-a46f-4ab1-8ff5-f92f990f5a91 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
18972025-08-28T21:45:38.912ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 5f723fda-7f75-4d68-9090-19887ccb9aea roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
18982025-08-28T21:45:38.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 5f723fda-7f75-4d68-9090-19887ccb9aea resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
18992025-08-28T21:45:38.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2580 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 5f723fda-7f75-4d68-9090-19887ccb9aea response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
19002025-08-28T21:45:39.748ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::d]:33903
19012025-08-28T21:45:39.748ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33903 req_id = c333d85e-9078-496e-bece-c01eb9b2d48c roles = RoleSet { roles: {} } uri = /metrics/collectors/fbcc3716-f2fd-4c7d-a691-c299da81c53f/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
19022025-08-28T21:45:39.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33903 req_id = c333d85e-9078-496e-bece-c01eb9b2d48c resource = Database result = Ok(()) uri = /metrics/collectors/fbcc3716-f2fd-4c7d-a691-c299da81c53f/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
19032025-08-28T21:45:39.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 3519 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33903 req_id = c333d85e-9078-496e-bece-c01eb9b2d48c response_code = 200 uri = /metrics/collectors/fbcc3716-f2fd-4c7d-a691-c299da81c53f/producers?sort_by=id_ascending
19042025-08-28T21:45:39.752ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33903 req_id = 3f51f788-f1ac-400c-ab37-cf582a49e67b roles = RoleSet { roles: {} } uri = /metrics/collectors/fbcc3716-f2fd-4c7d-a691-c299da81c53f/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE1M2ViMS1jM2Y2LTRhYjctYmU4Yi1hZWNmZDVmZWY0NTAifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
19052025-08-28T21:45:39.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33903 req_id = 3f51f788-f1ac-400c-ab37-cf582a49e67b resource = Database result = Ok(()) uri = /metrics/collectors/fbcc3716-f2fd-4c7d-a691-c299da81c53f/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE1M2ViMS1jM2Y2LTRhYjctYmU4Yi1hZWNmZDVmZWY0NTAifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
19062025-08-28T21:45:39.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2343 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33903 req_id = 3f51f788-f1ac-400c-ab37-cf582a49e67b response_code = 200 uri = /metrics/collectors/fbcc3716-f2fd-4c7d-a691-c299da81c53f/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE1M2ViMS1jM2Y2LTRhYjctYmU4Yi1hZWNmZDVmZWY0NTAifX0%3D
19072025-08-28T21:45:39.893ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2827 local_addr = [fd00:1122:3344:101::a]:41821 method = GET remote_addr = [fd00:1122:3344:101::d]:45939 req_id = 89fd7903-4f90-4afc-ab9d-332c664dda49 response_code = 200 uri = /0fe4e55a-5967-4507-9554-6c41366055df
19082025-08-28T21:45:39.928ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = a322a5ef-094e-4293-a4e1-2025577d5b06 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
19092025-08-28T21:45:39.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = a322a5ef-094e-4293-a4e1-2025577d5b06 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
19102025-08-28T21:45:39.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2229 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = a322a5ef-094e-4293-a4e1-2025577d5b06 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
19112025-08-28T21:45:40.944ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = f468389d-8c85-45bd-895f-811bc84edb1e roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
19122025-08-28T21:45:40.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = f468389d-8c85-45bd-895f-811bc84edb1e resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
19132025-08-28T21:45:40.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2172 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = f468389d-8c85-45bd-895f-811bc84edb1e response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
19142025-08-28T21:45:41.960ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 386621d4-0003-425f-9525-7259ee115c7f roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
19152025-08-28T21:45:41.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 386621d4-0003-425f-9525-7259ee115c7f resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
19162025-08-28T21:45:41.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2666 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 386621d4-0003-425f-9525-7259ee115c7f response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
19172025-08-28T21:45:42.446ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 148 reason = Timeout
19182025-08-28T21:45:42.446ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
19192025-08-28T21:45:42.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
19202025-08-28T21:45:42.449ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19212025-08-28T21:45:42.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
19222025-08-28T21:45:42.452ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
19232025-08-28T21:45:42.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
19242025-08-28T21:45:42.454ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
19252025-08-28T21:45:42.454ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.196933ms iteration = 148 status = {"chicken_switches_updated":false}
19262025-08-28T21:45:42.976ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 3862a2e3-499a-4fe2-a5b6-7ee4c89e7265 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
19272025-08-28T21:45:42.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 3862a2e3-499a-4fe2-a5b6-7ee4c89e7265 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
19282025-08-28T21:45:42.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2284 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 3862a2e3-499a-4fe2-a5b6-7ee4c89e7265 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
19292025-08-28T21:45:43.992ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = e2d65e57-29d2-4c19-8d9d-9fd1a1348ef9 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
19302025-08-28T21:45:43.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = e2d65e57-29d2-4c19-8d9d-9fd1a1348ef9 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
19312025-08-28T21:45:43.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2757 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = e2d65e57-29d2-4c19-8d9d-9fd1a1348ef9 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
19322025-08-28T21:45:45.008ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 717f6e47-c814-4b5a-a09c-efd56162afe6 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
19332025-08-28T21:45:45.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 717f6e47-c814-4b5a-a09c-efd56162afe6 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
19342025-08-28T21:45:45.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2779 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 717f6e47-c814-4b5a-a09c-efd56162afe6 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
19352025-08-28T21:45:46.025ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = deadc4ae-cfd6-4a22-943b-0de9dbc57c00 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
19362025-08-28T21:45:46.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = deadc4ae-cfd6-4a22-943b-0de9dbc57c00 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
19372025-08-28T21:45:46.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2184 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = deadc4ae-cfd6-4a22-943b-0de9dbc57c00 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
19382025-08-28T21:45:47.042ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 85cd829f-f823-4a6a-a821-09b6bb63da20 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
19392025-08-28T21:45:47.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 85cd829f-f823-4a6a-a821-09b6bb63da20 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
19402025-08-28T21:45:47.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2486 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 85cd829f-f823-4a6a-a821-09b6bb63da20 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
19412025-08-28T21:45:47.446ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
19422025-08-28T21:45:47.446ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
19432025-08-28T21:45:47.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19442025-08-28T21:45:47.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19452025-08-28T21:45:47.446ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 149 reason = Timeout
19462025-08-28T21:45:47.446ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
19472025-08-28T21:45:47.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
19482025-08-28T21:45:47.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19492025-08-28T21:45:47.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
19502025-08-28T21:45:47.449ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19512025-08-28T21:45:47.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19522025-08-28T21:45:47.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19532025-08-28T21:45:47.449ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19542025-08-28T21:45:47.450ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.60101ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19552025-08-28T21:45:47.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
19562025-08-28T21:45:47.453ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
19572025-08-28T21:45:47.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
19582025-08-28T21:45:47.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19592025-08-28T21:45:47.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19602025-08-28T21:45:47.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
19612025-08-28T21:45:47.454ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
19622025-08-28T21:45:47.454ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.665535ms iteration = 149 status = {"chicken_switches_updated":false}
19632025-08-28T21:45:47.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19642025-08-28T21:45:47.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
19652025-08-28T21:45:47.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19662025-08-28T21:45:47.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 75210457-5921-4367-8327-1fd4d2d66bd6, lookup_type: ById(75210457-5921-4367-8327-1fd4d2d66bd6) } result = Ok(())
19672025-08-28T21:45:47.458ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19682025-08-28T21:45:47.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
19692025-08-28T21:45:47.474ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 original_time_created = 2025-08-28 21:33:17.370599 UTC target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 time_created = 2025-08-28 21:33:17.370599 UTC
19702025-08-28T21:45:47.474ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.215571ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"75210457-5921-4367-8327-1fd4d2d66bd6","time_created":"2025-08-28T21:33:17.370599Z"}
19712025-08-28T21:45:48.057ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = cc23c75c-659e-478d-a6a0-211c5cf07909 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
19722025-08-28T21:45:48.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = cc23c75c-659e-478d-a6a0-211c5cf07909 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
19732025-08-28T21:45:48.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2067 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = cc23c75c-659e-478d-a6a0-211c5cf07909 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
19742025-08-28T21:45:49.073ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 91f8a284-72b0-40e6-8c25-b028baf74905 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
19752025-08-28T21:45:49.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 91f8a284-72b0-40e6-8c25-b028baf74905 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
19762025-08-28T21:45:49.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2551 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 91f8a284-72b0-40e6-8c25-b028baf74905 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
19772025-08-28T21:45:49.892ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2343 local_addr = [fd00:1122:3344:101::a]:41821 method = GET remote_addr = [fd00:1122:3344:101::d]:45939 req_id = 18502093-450b-42b7-8c79-8d5a843bc5ed response_code = 200 uri = /0fe4e55a-5967-4507-9554-6c41366055df
19782025-08-28T21:45:50.090ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 5dfaa2fd-702b-41d2-94e4-70ccd6ff37c5 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
19792025-08-28T21:45:50.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 5dfaa2fd-702b-41d2-94e4-70ccd6ff37c5 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
19802025-08-28T21:45:50.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2387 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 5dfaa2fd-702b-41d2-94e4-70ccd6ff37c5 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
19812025-08-28T21:45:51.106ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = ca247fb1-9a40-414b-96f9-21c455eb2c17 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
19822025-08-28T21:45:51.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = ca247fb1-9a40-414b-96f9-21c455eb2c17 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
19832025-08-28T21:45:51.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2194 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = ca247fb1-9a40-414b-96f9-21c455eb2c17 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
19842025-08-28T21:45:52.123ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = fed387e1-afd2-4ae6-9da8-62c4f7a185a1 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
19852025-08-28T21:45:52.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = fed387e1-afd2-4ae6-9da8-62c4f7a185a1 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
19862025-08-28T21:45:52.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2868 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = fed387e1-afd2-4ae6-9da8-62c4f7a185a1 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
19872025-08-28T21:45:52.446ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 150 reason = Timeout
19882025-08-28T21:45:52.446ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
19892025-08-28T21:45:52.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
19902025-08-28T21:45:52.449ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19912025-08-28T21:45:52.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
19922025-08-28T21:45:52.451ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
19932025-08-28T21:45:52.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
19942025-08-28T21:45:52.454ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
19952025-08-28T21:45:52.454ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.186392ms iteration = 150 status = {"chicken_switches_updated":false}
19962025-08-28T21:45:53.139ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = a596d07b-1ae6-454e-92a6-f72d07f21d63 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
19972025-08-28T21:45:53.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = a596d07b-1ae6-454e-92a6-f72d07f21d63 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
19982025-08-28T21:45:53.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2624 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = a596d07b-1ae6-454e-92a6-f72d07f21d63 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
19992025-08-28T21:45:54.156ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = de728ea5-4e3b-44fe-8b7c-4fd3e07ea887 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
20002025-08-28T21:45:54.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = de728ea5-4e3b-44fe-8b7c-4fd3e07ea887 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
20012025-08-28T21:45:54.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2451 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = de728ea5-4e3b-44fe-8b7c-4fd3e07ea887 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
20022025-08-28T21:45:54.748ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33903 req_id = bdbe4459-7c4c-4273-b20b-80d69c90d9df roles = RoleSet { roles: {} } uri = /metrics/collectors/fbcc3716-f2fd-4c7d-a691-c299da81c53f/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
20032025-08-28T21:45:54.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33903 req_id = bdbe4459-7c4c-4273-b20b-80d69c90d9df resource = Database result = Ok(()) uri = /metrics/collectors/fbcc3716-f2fd-4c7d-a691-c299da81c53f/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
20042025-08-28T21:45:54.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 3783 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33903 req_id = bdbe4459-7c4c-4273-b20b-80d69c90d9df response_code = 200 uri = /metrics/collectors/fbcc3716-f2fd-4c7d-a691-c299da81c53f/producers?sort_by=id_ascending
20052025-08-28T21:45:54.752ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33903 req_id = bae801b5-9852-4436-8c36-772a060beeb5 roles = RoleSet { roles: {} } uri = /metrics/collectors/fbcc3716-f2fd-4c7d-a691-c299da81c53f/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE1M2ViMS1jM2Y2LTRhYjctYmU4Yi1hZWNmZDVmZWY0NTAifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
20062025-08-28T21:45:54.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33903 req_id = bae801b5-9852-4436-8c36-772a060beeb5 resource = Database result = Ok(()) uri = /metrics/collectors/fbcc3716-f2fd-4c7d-a691-c299da81c53f/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE1M2ViMS1jM2Y2LTRhYjctYmU4Yi1hZWNmZDVmZWY0NTAifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
20072025-08-28T21:45:54.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2541 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33903 req_id = bae801b5-9852-4436-8c36-772a060beeb5 response_code = 200 uri = /metrics/collectors/fbcc3716-f2fd-4c7d-a691-c299da81c53f/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE1M2ViMS1jM2Y2LTRhYjctYmU4Yi1hZWNmZDVmZWY0NTAifX0%3D
20082025-08-28T21:45:55.172ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = e9f3ffca-cc74-4445-8511-de6d25518ae9 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
20092025-08-28T21:45:55.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = e9f3ffca-cc74-4445-8511-de6d25518ae9 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
20102025-08-28T21:45:55.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2866 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = e9f3ffca-cc74-4445-8511-de6d25518ae9 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
20112025-08-28T21:45:55.859ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::2]:50785
20122025-08-28T21:45:55.859ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50785 req_id = 7db93ffc-ceb5-4a11-80b5-efe5490b20a9 roles = RoleSet { roles: {} } uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
20132025-08-28T21:45:55.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50785 req_id = 7db93ffc-ceb5-4a11-80b5-efe5490b20a9 resource = Database result = Ok(()) uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
20142025-08-28T21:45:55.904ZINFOnexus: assigned collector to new producer collector_id = fbcc3716-f2fd-4c7d-a691-c299da81c53f file = nexus/src/app/oximeter.rs:76 producer_id = c1b563ac-cd21-457f-a655-648aede8da2f
20152025-08-28T21:45:55.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 44791 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50785 req_id = 7db93ffc-ceb5-4a11-80b5-efe5490b20a9 response_code = 201 uri = /metrics/producers
20162025-08-28T21:45:56.189ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 58d1d062-5943-4332-becf-649827a598ea roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
20172025-08-28T21:45:56.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 58d1d062-5943-4332-becf-649827a598ea resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
20182025-08-28T21:45:56.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2915 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 58d1d062-5943-4332-becf-649827a598ea response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
20192025-08-28T21:45:56.848ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::2]:58020
20202025-08-28T21:45:56.848ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58020 req_id = 9bf18c6a-d71c-422a-975b-25cf3dd62c71 roles = RoleSet { roles: {} } uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
20212025-08-28T21:45:56.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58020 req_id = 9bf18c6a-d71c-422a-975b-25cf3dd62c71 resource = Database result = Ok(()) uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
20222025-08-28T21:45:56.859ZINFOnexus: assigned collector to new producer collector_id = fbcc3716-f2fd-4c7d-a691-c299da81c53f file = nexus/src/app/oximeter.rs:76 producer_id = e1a53eb1-c3f6-4ab7-be8b-aecfd5fef450
20232025-08-28T21:45:56.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 10538 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58020 req_id = 9bf18c6a-d71c-422a-975b-25cf3dd62c71 response_code = 201 uri = /metrics/producers
20242025-08-28T21:45:57.207ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 9d4ff6db-e78f-4173-9dff-a71314d5ddf4 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
20252025-08-28T21:45:57.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 9d4ff6db-e78f-4173-9dff-a71314d5ddf4 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
20262025-08-28T21:45:57.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2381 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 9d4ff6db-e78f-4173-9dff-a71314d5ddf4 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
20272025-08-28T21:45:57.313ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
20282025-08-28T21:45:57.314ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
20292025-08-28T21:45:57.314ZDEBGnexus (BackgroundTasks): activating background_task = nat_garbage_collector iteration = 26 reason = Timeout
20302025-08-28T21:45:57.314ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
20312025-08-28T21:45:57.314ZDEBGnexus (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
20322025-08-28T21:45:57.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = bfd_manager resource = Database result = Ok(())
20332025-08-28T21:45:57.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
20342025-08-28T21:45:57.316ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1725, tv_nsec: 848476948 } })
20352025-08-28T21:45:57.316ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1725, tv_nsec: 848614512 } })
20362025-08-28T21:45:57.317ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1205
20372025-08-28T21:45:57.318ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.135297ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
20382025-08-28T21:45:57.318ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_garbage_collector file = nexus/src/app/mod.rs:1205
20392025-08-28T21:45:57.376ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1213 zone_address = fd00:1122:3344:101::2
20402025-08-28T21:45:57.376ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20412025-08-28T21:45:57.376ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b556838d-7d4b-4e86-9105-7bdb18201e16", "content-length": "26", "date": "Thu, 28 Aug 2025 21:45:57 GMT"} })
20422025-08-28T21:45:57.376ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1216 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20432025-08-28T21:45:57.378ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1250 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20442025-08-28T21:45:57.378ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_garbage_collector file = nexus/src/app/mod.rs:1213 zone_address = fd00:1122:3344:101::2
20452025-08-28T21:45:57.378ZDEBGnexus (MgsClient): client request background_task = nat_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20462025-08-28T21:45:57.378ZDEBGnexus (MgsClient): client response background_task = nat_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f7e6b79-9474-4ffd-a99f-6e85c9fa923f", "content-length": "26", "date": "Thu, 28 Aug 2025 21:45:56 GMT"} })
20472025-08-28T21:45:57.378ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_garbage_collector file = nexus/src/app/mod.rs:1216 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20482025-08-28T21:45:57.381ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_garbage_collector file = nexus/src/app/mod.rs:1250 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20492025-08-28T21:45:57.440ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 126.353408ms iteration = 26 status = {}
20502025-08-28T21:45:57.442ZDEBGnexus (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
20512025-08-28T21:45:57.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
20522025-08-28T21:45:57.445ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_garbage_collector elapsed = 131.183012ms iteration = 26 status = null
20532025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 26 reason = Timeout
20542025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 10.99\u{b5}s iteration = 26 status = {"disabled":true,"errors":[],"sps":[]}
20552025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
20562025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
20572025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
20582025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
20592025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20602025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20612025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20622025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 26 reason = Timeout
20632025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
20642025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
20652025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
20662025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
20672025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
20682025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
20692025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
20702025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20712025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
20722025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20732025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20742025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 151 reason = Timeout
20752025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
20762025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
20772025-08-28T21:45:57.446ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
20782025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
20792025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20802025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20812025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
20822025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20832025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 26 reason = Timeout
20842025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
20852025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
20862025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20872025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
20882025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20892025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
20902025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20912025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20922025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20932025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
20942025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
20952025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
20962025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20972025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20982025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
20992025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
21002025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21012025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
21022025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
21032025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21042025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
21052025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
21062025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
21072025-08-28T21:45:57.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21082025-08-28T21:45:57.448ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.663169ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
21092025-08-28T21:45:57.450ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
21102025-08-28T21:45:57.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
21112025-08-28T21:45:57.451ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21122025-08-28T21:45:57.451ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
21132025-08-28T21:45:57.451ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21142025-08-28T21:45:57.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
21152025-08-28T21:45:57.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21162025-08-28T21:45:57.454ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21172025-08-28T21:45:57.454ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21182025-08-28T21:45:57.454ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21192025-08-28T21:45:57.454ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21202025-08-28T21:45:57.454ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21212025-08-28T21:45:57.456ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21222025-08-28T21:45:57.459ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21232025-08-28T21:45:57.459ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21242025-08-28T21:45:57.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21252025-08-28T21:45:57.459ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21262025-08-28T21:45:57.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21272025-08-28T21:45:57.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
21282025-08-28T21:45:57.459ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21292025-08-28T21:45:57.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21302025-08-28T21:45:57.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21312025-08-28T21:45:57.464ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Fleet result = Ok(())
21322025-08-28T21:45:57.464ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
21332025-08-28T21:45:57.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
21342025-08-28T21:45:57.464ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
21352025-08-28T21:45:57.464ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
21362025-08-28T21:45:57.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
21372025-08-28T21:45:57.464ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21382025-08-28T21:45:57.464ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
21392025-08-28T21:45:57.464ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
21402025-08-28T21:45:57.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
21412025-08-28T21:45:57.465ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21422025-08-28T21:45:57.465ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1725, tv_nsec: 997107783 } })
21432025-08-28T21:45:57.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21442025-08-28T21:45:57.465ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1205 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1
21452025-08-28T21:45:57.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21462025-08-28T21:45:57.465ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21472025-08-28T21:45:57.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
21482025-08-28T21:45:57.466ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21492025-08-28T21:45:57.466ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
21502025-08-28T21:45:57.466ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 20.839081ms iteration = 151 status = {"chicken_switches_updated":false}
21512025-08-28T21:45:57.467ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21522025-08-28T21:45:57.467ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21532025-08-28T21:45:57.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21542025-08-28T21:45:57.468ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21552025-08-28T21:45:57.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
21562025-08-28T21:45:57.469ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21572025-08-28T21:45:57.469ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21582025-08-28T21:45:57.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21592025-08-28T21:45:57.469ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21602025-08-28T21:45:57.469ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21612025-08-28T21:45:57.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
21622025-08-28T21:45:57.472ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 75210457-5921-4367-8327-1fd4d2d66bd6, lookup_type: ById(75210457-5921-4367-8327-1fd4d2d66bd6) } result = Ok(())
21632025-08-28T21:45:57.472ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21642025-08-28T21:45:57.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
21652025-08-28T21:45:57.485ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21662025-08-28T21:45:57.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
21672025-08-28T21:45:57.489ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21682025-08-28T21:45:57.491ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21692025-08-28T21:45:57.491ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21702025-08-28T21:45:57.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
21712025-08-28T21:45:57.493ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21722025-08-28T21:45:57.496ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21732025-08-28T21:45:57.496ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21742025-08-28T21:45:57.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
21752025-08-28T21:45:57.503ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 original_time_created = 2025-08-28 21:33:17.370599 UTC target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 time_created = 2025-08-28 21:33:17.370599 UTC
21762025-08-28T21:45:57.503ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 57.255665ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"75210457-5921-4367-8327-1fd4d2d66bd6","time_created":"2025-08-28T21:33:17.370599Z"}
21772025-08-28T21:45:57.509ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21782025-08-28T21:45:57.510ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21792025-08-28T21:45:57.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21802025-08-28T21:45:57.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21812025-08-28T21:45:57.512ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 66.223038ms iteration = 26 status = {"errors":[],"requests_created_ok":[]}
21822025-08-28T21:45:57.513ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21832025-08-28T21:45:57.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21842025-08-28T21:45:57.514ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 68.477857ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
21852025-08-28T21:45:57.514ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
21862025-08-28T21:45:57.514ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 68.734593ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
21872025-08-28T21:45:57.515ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 69.38968ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
21882025-08-28T21:45:57.515ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 69.271576ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
21892025-08-28T21:45:57.515ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21902025-08-28T21:45:57.515ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
21912025-08-28T21:45:57.515ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21922025-08-28T21:45:57.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
21932025-08-28T21:45:57.516ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
21942025-08-28T21:45:57.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
21952025-08-28T21:45:57.517ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21962025-08-28T21:45:57.518ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 72.09013ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
21972025-08-28T21:45:57.520ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
21982025-08-28T21:45:57.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
21992025-08-28T21:45:57.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
22002025-08-28T21:45:57.521ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22012025-08-28T21:45:57.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22022025-08-28T21:45:57.523ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22032025-08-28T21:45:57.523ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22042025-08-28T21:45:57.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22052025-08-28T21:45:57.527ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
22062025-08-28T21:45:57.527ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
22072025-08-28T21:45:57.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
22082025-08-28T21:45:57.560ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1213 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 zone_address = fd00:1122:3344:101::2
22092025-08-28T21:45:57.561ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22102025-08-28T21:45:57.561ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3127b9fa-24e0-46cb-b154-645b1dd8950c", "content-length": "26", "date": "Thu, 28 Aug 2025 21:45:57 GMT"} })
22112025-08-28T21:45:57.561ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1216 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22122025-08-28T21:45:57.565ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1250 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1
22132025-08-28T21:45:57.592ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22142025-08-28T21:45:57.592ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
22152025-08-28T21:45:57.592ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 146.11925ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
22162025-08-28T21:45:57.593ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22172025-08-28T21:45:57.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22182025-08-28T21:45:57.595ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 149.446476ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22192025-08-28T21:45:57.596ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22202025-08-28T21:45:57.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22212025-08-28T21:45:57.598ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22222025-08-28T21:45:57.601ZINFOnexus (BackgroundTasks): VPC route manager sled af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
22232025-08-28T21:45:57.601ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22242025-08-28T21:45:57.601ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
22252025-08-28T21:45:57.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: af8277ed-838c-4274-8629-14eae35fd0e4, lookup_type: ById(af8277ed-838c-4274-8629-14eae35fd0e4) } result = Ok(())
22262025-08-28T21:45:57.603ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22272025-08-28T21:45:57.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22282025-08-28T21:45:57.604ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
22292025-08-28T21:45:57.604ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 158.243765ms iteration = 26 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
22302025-08-28T21:45:57.605ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d83aa46f-bec8-41be-a8e5-588c676d9f04", "content-length": "372", "date": "Thu, 28 Aug 2025 21:45:57 GMT"} })
22312025-08-28T21:45:57.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22322025-08-28T21:45:57.605ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9536fd9-2b7e-4039-a9e4-c34632387037", "content-length": "691", "date": "Thu, 28 Aug 2025 21:45:57 GMT"} })
22332025-08-28T21:45:57.605ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
22342025-08-28T21:45:57.605ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
22352025-08-28T21:45:57.605ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
22362025-08-28T21:45:57.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22372025-08-28T21:45:57.606ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 160.597366ms iteration = 26 status = 0
22382025-08-28T21:45:57.606ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 160.810151ms iteration = 29 status = {}
22392025-08-28T21:45:57.624ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
22402025-08-28T21:45:57.624ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
22412025-08-28T21:45:57.625ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4cdd1b2d-4d6c-4922-ac35-05978c66c573", "date": "Thu, 28 Aug 2025 21:45:57 GMT"} })
22422025-08-28T21:45:57.625ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22432025-08-28T21:45:57.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22442025-08-28T21:45:57.628ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22452025-08-28T21:45:57.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22462025-08-28T21:45:57.631ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22472025-08-28T21:45:57.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22482025-08-28T21:45:57.635ZINFOnexus (BackgroundTasks): VPC route manager sled af8277ed-838c-4274-8629-14eae35fd0e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
22492025-08-28T21:45:57.635ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22502025-08-28T21:45:57.635ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "49818655-a379-4c07-9cea-2b17f4c6273d", "date": "Thu, 28 Aug 2025 21:45:57 GMT"} })
22512025-08-28T21:45:57.638ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 192.070262ms iteration = 31 status = {}
22522025-08-28T21:45:57.666ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 220.009167ms iteration = 30 status = {"physical_disks_added":0}
22532025-08-28T21:45:57.710ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22542025-08-28T21:45:57.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22552025-08-28T21:45:57.713ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 00cfe4f2-9fed-42f3-bd7c-dbdf1ed57d5e, rack_id: 8a92b2f1-f565-4a24-a10f-f55b1f446cc1, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(c2e57029-848b-4db2-bb2f-4a9b47d7bf41) } rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 switch_location = Switch0
22562025-08-28T21:45:57.713ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22572025-08-28T21:45:57.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22582025-08-28T21:45:57.725ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
22592025-08-28T21:45:57.725ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = c2e57029-848b-4db2-bb2f-4a9b47d7bf41
22602025-08-28T21:45:57.726ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
22612025-08-28T21:45:57.726ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
22622025-08-28T21:45:57.726ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22632025-08-28T21:45:57.726ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22642025-08-28T21:45:57.726ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22652025-08-28T21:45:57.726ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22662025-08-28T21:45:57.726ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22672025-08-28T21:45:57.726ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22682025-08-28T21:45:57.726ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1
22692025-08-28T21:45:57.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22702025-08-28T21:45:57.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22712025-08-28T21:45:57.729ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 switch_location = Switch0
22722025-08-28T21:45:57.729ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
22732025-08-28T21:45:57.868ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4d17baf8-ecfb-41b7-bfe2-cd340b77cff3", "date": "Thu, 28 Aug 2025 21:45:57 GMT"} })
22742025-08-28T21:45:57.869ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 switch = Switch0
22752025-08-28T21:45:57.869ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
22762025-08-28T21:45:57.875ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a834e4ce-baf2-4b9f-a2c8-a8655f70d245", "content-length": "682", "date": "Thu, 28 Aug 2025 21:45:57 GMT"} })
22772025-08-28T21:45:57.876ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22782025-08-28T21:45:57.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22792025-08-28T21:45:57.879ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22802025-08-28T21:45:57.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22812025-08-28T21:45:57.882ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22822025-08-28T21:45:57.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22832025-08-28T21:45:57.885ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22842025-08-28T21:45:57.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22852025-08-28T21:45:57.893ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 447.011424ms iteration = 26 status = {}
22862025-08-28T21:45:58.223ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = abe90e0d-9e6d-4304-9958-28f9294682a4 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
22872025-08-28T21:45:58.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = abe90e0d-9e6d-4304-9958-28f9294682a4 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
22882025-08-28T21:45:58.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2054 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = abe90e0d-9e6d-4304-9958-28f9294682a4 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
22892025-08-28T21:45:58.422ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::1]:44847
22902025-08-28T21:45:58.422ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44847 req_id = 25bec8fc-e068-4b82-a80c-aa32c4d153bf roles = RoleSet { roles: {} } uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
22912025-08-28T21:45:58.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44847 req_id = 25bec8fc-e068-4b82-a80c-aa32c4d153bf resource = Database result = Ok(()) uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
22922025-08-28T21:45:58.462ZINFOnexus: assigned collector to new producer collector_id = fbcc3716-f2fd-4c7d-a691-c299da81c53f file = nexus/src/app/oximeter.rs:76 producer_id = 7e9efa39-d076-4442-99df-a99f7ff43dfc
22932025-08-28T21:45:58.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 40495 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44847 req_id = 25bec8fc-e068-4b82-a80c-aa32c4d153bf response_code = 201 uri = /metrics/producers
22942025-08-28T21:45:59.204ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::2]:45932
22952025-08-28T21:45:59.204ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45932 req_id = 9f299106-257f-4180-9296-20a97a9697cc roles = RoleSet { roles: {} } uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
22962025-08-28T21:45:59.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45932 req_id = 9f299106-257f-4180-9296-20a97a9697cc resource = Database result = Ok(()) uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
22972025-08-28T21:45:59.214ZINFOnexus: assigned collector to new producer collector_id = fbcc3716-f2fd-4c7d-a691-c299da81c53f file = nexus/src/app/oximeter.rs:76 producer_id = d85278d5-3df5-4e1b-9b1f-5a419b3651a7
22982025-08-28T21:45:59.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 9719 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45932 req_id = 9f299106-257f-4180-9296-20a97a9697cc response_code = 201 uri = /metrics/producers
22992025-08-28T21:45:59.241ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = d1c1089c-ac61-45d4-889e-70cc49482013 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23002025-08-28T21:45:59.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = d1c1089c-ac61-45d4-889e-70cc49482013 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23012025-08-28T21:45:59.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2115 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = d1c1089c-ac61-45d4-889e-70cc49482013 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
23022025-08-28T21:45:59.893ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2569 local_addr = [fd00:1122:3344:101::a]:41821 method = GET remote_addr = [fd00:1122:3344:101::d]:45939 req_id = 33145275-6073-4cd4-b0fc-e5d0ea1a4caf response_code = 200 uri = /0fe4e55a-5967-4507-9554-6c41366055df
23032025-08-28T21:46:00.257ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 36ff0d73-64f7-4c98-96c6-99526016c782 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23042025-08-28T21:46:00.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 36ff0d73-64f7-4c98-96c6-99526016c782 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23052025-08-28T21:46:00.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2485 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 36ff0d73-64f7-4c98-96c6-99526016c782 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
23062025-08-28T21:46:01.273ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 13f1919b-db0d-4182-8197-66653231a86a roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23072025-08-28T21:46:01.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 13f1919b-db0d-4182-8197-66653231a86a resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23082025-08-28T21:46:01.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2553 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 13f1919b-db0d-4182-8197-66653231a86a response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
23092025-08-28T21:46:02.289ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 824bacc0-b85c-430b-a54b-dd6b15035644 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23102025-08-28T21:46:02.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 824bacc0-b85c-430b-a54b-dd6b15035644 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23112025-08-28T21:46:02.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2343 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 824bacc0-b85c-430b-a54b-dd6b15035644 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
23122025-08-28T21:46:02.446ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 152 reason = Timeout
23132025-08-28T21:46:02.446ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
23142025-08-28T21:46:02.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
23152025-08-28T21:46:02.448ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23162025-08-28T21:46:02.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
23172025-08-28T21:46:02.451ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
23182025-08-28T21:46:02.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
23192025-08-28T21:46:02.453ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
23202025-08-28T21:46:02.453ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.281318ms iteration = 152 status = {"chicken_switches_updated":false}
23212025-08-28T21:46:03.305ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 59cbf629-7379-4c2c-ac29-392e91a84e8f roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23222025-08-28T21:46:03.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 59cbf629-7379-4c2c-ac29-392e91a84e8f resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23232025-08-28T21:46:03.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2658 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 59cbf629-7379-4c2c-ac29-392e91a84e8f response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
23242025-08-28T21:46:04.321ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = d3825152-3f15-42fe-be42-ccd8f5c4cfc4 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23252025-08-28T21:46:04.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = d3825152-3f15-42fe-be42-ccd8f5c4cfc4 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23262025-08-28T21:46:04.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2062 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = d3825152-3f15-42fe-be42-ccd8f5c4cfc4 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
23272025-08-28T21:46:04.550ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::2]:42525
23282025-08-28T21:46:04.550ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42525 req_id = 6cda96e9-9322-40ad-9566-b6b79e05d488 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23292025-08-28T21:46:04.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42525 req_id = 6cda96e9-9322-40ad-9566-b6b79e05d488 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23302025-08-28T21:46:04.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 3275 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42525 req_id = 6cda96e9-9322-40ad-9566-b6b79e05d488 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
23312025-08-28T21:46:05.336ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 8bc5c067-d4aa-4af3-9fe1-6206774a9a40 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23322025-08-28T21:46:05.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 8bc5c067-d4aa-4af3-9fe1-6206774a9a40 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23332025-08-28T21:46:05.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2324 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 8bc5c067-d4aa-4af3-9fe1-6206774a9a40 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
23342025-08-28T21:46:06.351ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = b550ce01-4809-4547-bf29-a96869970055 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23352025-08-28T21:46:06.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = b550ce01-4809-4547-bf29-a96869970055 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23362025-08-28T21:46:06.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2425 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = b550ce01-4809-4547-bf29-a96869970055 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
23372025-08-28T21:46:06.836ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::2]:58937
23382025-08-28T21:46:06.836ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58937 req_id = 202e854b-2d32-42b2-bff8-c33dda1229d9 roles = RoleSet { roles: {} } uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
23392025-08-28T21:46:06.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58937 req_id = 202e854b-2d32-42b2-bff8-c33dda1229d9 resource = Database result = Ok(()) uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
23402025-08-28T21:46:06.848ZINFOnexus: assigned collector to new producer collector_id = fbcc3716-f2fd-4c7d-a691-c299da81c53f file = nexus/src/app/oximeter.rs:76 producer_id = e1a53eb1-c3f6-4ab7-be8b-aecfd5fef450
23412025-08-28T21:46:06.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 11839 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58937 req_id = 202e854b-2d32-42b2-bff8-c33dda1229d9 response_code = 201 uri = /metrics/producers
23422025-08-28T21:46:07.368ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 10e47a32-0a43-4886-9ee4-cf7205b3e379 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23432025-08-28T21:46:07.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 10e47a32-0a43-4886-9ee4-cf7205b3e379 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23442025-08-28T21:46:07.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2027 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 10e47a32-0a43-4886-9ee4-cf7205b3e379 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
23452025-08-28T21:46:07.445ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
23462025-08-28T21:46:07.445ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
23472025-08-28T21:46:07.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23482025-08-28T21:46:07.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23492025-08-28T21:46:07.446ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 153 reason = Timeout
23502025-08-28T21:46:07.446ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
23512025-08-28T21:46:07.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
23522025-08-28T21:46:07.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23532025-08-28T21:46:07.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
23542025-08-28T21:46:07.448ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23552025-08-28T21:46:07.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23562025-08-28T21:46:07.448ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23572025-08-28T21:46:07.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23582025-08-28T21:46:07.450ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.177568ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23592025-08-28T21:46:07.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
23602025-08-28T21:46:07.451ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
23612025-08-28T21:46:07.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23622025-08-28T21:46:07.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23632025-08-28T21:46:07.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
23642025-08-28T21:46:07.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
23652025-08-28T21:46:07.453ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
23662025-08-28T21:46:07.453ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.32645ms iteration = 153 status = {"chicken_switches_updated":false}
23672025-08-28T21:46:07.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23682025-08-28T21:46:07.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
23692025-08-28T21:46:07.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23702025-08-28T21:46:07.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 75210457-5921-4367-8327-1fd4d2d66bd6, lookup_type: ById(75210457-5921-4367-8327-1fd4d2d66bd6) } result = Ok(())
23712025-08-28T21:46:07.458ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23722025-08-28T21:46:07.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
23732025-08-28T21:46:07.472ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 original_time_created = 2025-08-28 21:33:17.370599 UTC target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 time_created = 2025-08-28 21:33:17.370599 UTC
23742025-08-28T21:46:07.472ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.367434ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"75210457-5921-4367-8327-1fd4d2d66bd6","time_created":"2025-08-28T21:33:17.370599Z"}
23752025-08-28T21:46:08.384ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = c0268f04-2bab-4f79-90b6-e531c1838e43 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23762025-08-28T21:46:08.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = c0268f04-2bab-4f79-90b6-e531c1838e43 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23772025-08-28T21:46:08.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2851 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = c0268f04-2bab-4f79-90b6-e531c1838e43 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
23782025-08-28T21:46:09.402ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 0791eb72-98dd-460d-9659-dea7f3bbfc7b roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23792025-08-28T21:46:09.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 0791eb72-98dd-460d-9659-dea7f3bbfc7b resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23802025-08-28T21:46:09.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2318 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 0791eb72-98dd-460d-9659-dea7f3bbfc7b response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
23812025-08-28T21:46:09.893ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2667 local_addr = [fd00:1122:3344:101::a]:41821 method = GET remote_addr = [fd00:1122:3344:101::d]:45939 req_id = c39edd69-1408-493d-806d-3af27c836a31 response_code = 200 uri = /0fe4e55a-5967-4507-9554-6c41366055df
23822025-08-28T21:46:10.417ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 629370e7-6cd6-487b-9935-e2256ad91f86 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23832025-08-28T21:46:10.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 629370e7-6cd6-487b-9935-e2256ad91f86 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23842025-08-28T21:46:10.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2283 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 629370e7-6cd6-487b-9935-e2256ad91f86 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
23852025-08-28T21:46:11.434ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 28cd14ae-4f9f-4057-afd0-fb1228446b92 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23862025-08-28T21:46:11.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 28cd14ae-4f9f-4057-afd0-fb1228446b92 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23872025-08-28T21:46:11.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2573 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 28cd14ae-4f9f-4057-afd0-fb1228446b92 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
23882025-08-28T21:46:12.446ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 154 reason = Timeout
23892025-08-28T21:46:12.446ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
23902025-08-28T21:46:12.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
23912025-08-28T21:46:12.448ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23922025-08-28T21:46:12.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
23932025-08-28T21:46:12.450ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
23942025-08-28T21:46:12.450ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = fff06bb2-d821-444c-b4dd-5e51516591ea roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23952025-08-28T21:46:12.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
23962025-08-28T21:46:12.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = fff06bb2-d821-444c-b4dd-5e51516591ea resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
23972025-08-28T21:46:12.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 1954 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = fff06bb2-d821-444c-b4dd-5e51516591ea response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
23982025-08-28T21:46:12.453ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
23992025-08-28T21:46:12.453ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.101674ms iteration = 154 status = {"chicken_switches_updated":false}
24002025-08-28T21:46:13.456ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::1]:65013
24012025-08-28T21:46:13.456ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:65013 req_id = f1572cc0-eaa7-4d70-81bc-893ecfcafdc8 roles = RoleSet { roles: {} } uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
24022025-08-28T21:46:13.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:65013 req_id = f1572cc0-eaa7-4d70-81bc-893ecfcafdc8 resource = Database result = Ok(()) uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
24032025-08-28T21:46:13.465ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 0069786a-0cd4-4fb8-9d6c-483d718047fc roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
24042025-08-28T21:46:13.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 0069786a-0cd4-4fb8-9d6c-483d718047fc resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
24052025-08-28T21:46:13.466ZINFOnexus: assigned collector to new producer collector_id = fbcc3716-f2fd-4c7d-a691-c299da81c53f file = nexus/src/app/oximeter.rs:76 producer_id = af8277ed-838c-4274-8629-14eae35fd0e4
24062025-08-28T21:46:13.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 9952 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:65013 req_id = f1572cc0-eaa7-4d70-81bc-893ecfcafdc8 response_code = 201 uri = /metrics/producers
24072025-08-28T21:46:13.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2500 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 0069786a-0cd4-4fb8-9d6c-483d718047fc response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
24082025-08-28T21:46:14.481ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 36caae53-b0f1-440b-a278-c656e7c976c8 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
24092025-08-28T21:46:14.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 36caae53-b0f1-440b-a278-c656e7c976c8 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
24102025-08-28T21:46:14.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2166 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 36caae53-b0f1-440b-a278-c656e7c976c8 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
24112025-08-28T21:46:15.496ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = cb032928-23b0-4eac-b723-605a0695923e roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
24122025-08-28T21:46:15.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = cb032928-23b0-4eac-b723-605a0695923e resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
24132025-08-28T21:46:15.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2743 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = cb032928-23b0-4eac-b723-605a0695923e response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
24142025-08-28T21:46:16.513ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 86978b93-b8c4-4b6b-8042-ce4357ece1c4 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
24152025-08-28T21:46:16.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 86978b93-b8c4-4b6b-8042-ce4357ece1c4 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
24162025-08-28T21:46:16.513ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::2]:41883
24172025-08-28T21:46:16.513ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41883 req_id = 24124f69-6d74-458a-bf6d-a956f6270274 roles = RoleSet { roles: {} } uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
24182025-08-28T21:46:16.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41883 req_id = 24124f69-6d74-458a-bf6d-a956f6270274 resource = Database result = Ok(()) uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
24192025-08-28T21:46:16.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2214 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 86978b93-b8c4-4b6b-8042-ce4357ece1c4 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
24202025-08-28T21:46:16.524ZINFOnexus: assigned collector to new producer collector_id = fbcc3716-f2fd-4c7d-a691-c299da81c53f file = nexus/src/app/oximeter.rs:76 producer_id = a3818313-80ce-4697-8069-3095de9211b2
24212025-08-28T21:46:16.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 10394 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41883 req_id = 24124f69-6d74-458a-bf6d-a956f6270274 response_code = 201 uri = /metrics/producers
24222025-08-28T21:46:17.446ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
24232025-08-28T21:46:17.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24242025-08-28T21:46:17.446ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
24252025-08-28T21:46:17.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24262025-08-28T21:46:17.446ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 155 reason = Timeout
24272025-08-28T21:46:17.446ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
24282025-08-28T21:46:17.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24292025-08-28T21:46:17.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
24302025-08-28T21:46:17.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
24312025-08-28T21:46:17.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24322025-08-28T21:46:17.449ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24332025-08-28T21:46:17.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24342025-08-28T21:46:17.449ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24352025-08-28T21:46:17.451ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.525107ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24362025-08-28T21:46:17.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24372025-08-28T21:46:17.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24382025-08-28T21:46:17.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
24392025-08-28T21:46:17.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
24402025-08-28T21:46:17.453ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
24412025-08-28T21:46:17.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
24422025-08-28T21:46:17.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24432025-08-28T21:46:17.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
24442025-08-28T21:46:17.455ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
24452025-08-28T21:46:17.455ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.725577ms iteration = 155 status = {"chicken_switches_updated":false}
24462025-08-28T21:46:17.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24472025-08-28T21:46:17.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 75210457-5921-4367-8327-1fd4d2d66bd6, lookup_type: ById(75210457-5921-4367-8327-1fd4d2d66bd6) } result = Ok(())
24482025-08-28T21:46:17.458ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24492025-08-28T21:46:17.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
24502025-08-28T21:46:17.472ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 original_time_created = 2025-08-28 21:33:17.370599 UTC target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 time_created = 2025-08-28 21:33:17.370599 UTC
24512025-08-28T21:46:17.472ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.044485ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"75210457-5921-4367-8327-1fd4d2d66bd6","time_created":"2025-08-28T21:33:17.370599Z"}
24522025-08-28T21:46:17.529ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 905c9e68-6691-43a2-82ee-9bae269cba24 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
24532025-08-28T21:46:17.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 905c9e68-6691-43a2-82ee-9bae269cba24 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
24542025-08-28T21:46:17.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 1505 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 905c9e68-6691-43a2-82ee-9bae269cba24 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
24552025-08-28T21:46:18.546ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = c4787e90-743b-4eba-b6db-e5d40204d0ee roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
24562025-08-28T21:46:18.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = c4787e90-743b-4eba-b6db-e5d40204d0ee resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
24572025-08-28T21:46:18.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2507 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = c4787e90-743b-4eba-b6db-e5d40204d0ee response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
24582025-08-28T21:46:19.561ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 44060ce9-41aa-475d-8bf3-b75bab348b2b roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
24592025-08-28T21:46:19.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 44060ce9-41aa-475d-8bf3-b75bab348b2b resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
24602025-08-28T21:46:19.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2584 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 44060ce9-41aa-475d-8bf3-b75bab348b2b response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
24612025-08-28T21:46:19.892ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2590 local_addr = [fd00:1122:3344:101::a]:41821 method = GET remote_addr = [fd00:1122:3344:101::d]:45939 req_id = e6a8cf2f-6c89-4999-b308-e6afe04f0d99 response_code = 200 uri = /0fe4e55a-5967-4507-9554-6c41366055df
24622025-08-28T21:46:20.577ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = c7d12b90-cfa9-4dd3-be0d-fddde7a0331b roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
24632025-08-28T21:46:20.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = c7d12b90-cfa9-4dd3-be0d-fddde7a0331b resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
24642025-08-28T21:46:20.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2505 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = c7d12b90-cfa9-4dd3-be0d-fddde7a0331b response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
24652025-08-28T21:46:21.594ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 994f8756-cf3e-47f4-b4d0-c125e96c89cd roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
24662025-08-28T21:46:21.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 994f8756-cf3e-47f4-b4d0-c125e96c89cd resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
24672025-08-28T21:46:21.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2729 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 994f8756-cf3e-47f4-b4d0-c125e96c89cd response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
24682025-08-28T21:46:22.446ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 156 reason = Timeout
24692025-08-28T21:46:22.446ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
24702025-08-28T21:46:22.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
24712025-08-28T21:46:22.448ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24722025-08-28T21:46:22.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
24732025-08-28T21:46:22.451ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
24742025-08-28T21:46:22.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
24752025-08-28T21:46:22.453ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
24762025-08-28T21:46:22.453ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.129275ms iteration = 156 status = {"chicken_switches_updated":false}
24772025-08-28T21:46:22.611ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 36826b54-6bfb-494e-9f05-5aa3ac42af0f roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
24782025-08-28T21:46:22.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 36826b54-6bfb-494e-9f05-5aa3ac42af0f resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
24792025-08-28T21:46:22.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2642 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 36826b54-6bfb-494e-9f05-5aa3ac42af0f response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
24802025-08-28T21:46:23.627ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 8827c460-6977-46c0-94e4-92b689e3f276 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
24812025-08-28T21:46:23.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 8827c460-6977-46c0-94e4-92b689e3f276 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
24822025-08-28T21:46:23.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2343 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 8827c460-6977-46c0-94e4-92b689e3f276 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
24832025-08-28T21:46:24.643ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = bd156b66-8351-4ae6-8ceb-2f69ec4ff2fc roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
24842025-08-28T21:46:24.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = bd156b66-8351-4ae6-8ceb-2f69ec4ff2fc resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
24852025-08-28T21:46:24.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2453 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = bd156b66-8351-4ae6-8ceb-2f69ec4ff2fc response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
24862025-08-28T21:46:25.660ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 991de982-7c9f-45d5-be74-a148e589ab95 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
24872025-08-28T21:46:25.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 991de982-7c9f-45d5-be74-a148e589ab95 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
24882025-08-28T21:46:25.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2095 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 991de982-7c9f-45d5-be74-a148e589ab95 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
24892025-08-28T21:46:26.677ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 31c430a3-c8c0-45cd-ba93-38669743f7b3 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
24902025-08-28T21:46:26.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 31c430a3-c8c0-45cd-ba93-38669743f7b3 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
24912025-08-28T21:46:26.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2690 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 31c430a3-c8c0-45cd-ba93-38669743f7b3 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
24922025-08-28T21:46:27.313ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
24932025-08-28T21:46:27.313ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:91 reason = blueprint disabled target_id = 75210457-5921-4367-8327-1fd4d2d66bd6
24942025-08-28T21:46:27.313ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 28.94\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"75210457-5921-4367-8327-1fd4d2d66bd6"}
24952025-08-28T21:46:27.313ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
24962025-08-28T21:46:27.313ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
24972025-08-28T21:46:27.313ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
24982025-08-28T21:46:27.313ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
24992025-08-28T21:46:27.313ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25002025-08-28T21:46:27.313ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-28 21:36:27.313796020 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
25012025-08-28T21:46:27.313ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
25022025-08-28T21:46:27.313ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
25032025-08-28T21:46:27.313ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
25042025-08-28T21:46:27.313ZDEBGnexus (BackgroundTasks): activating background_task = nat_garbage_collector iteration = 27 reason = Timeout
25052025-08-28T21:46:27.313ZDEBGnexus (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
25062025-08-28T21:46:27.313ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
25072025-08-28T21:46:27.313ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
25082025-08-28T21:46:27.313ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
25092025-08-28T21:46:27.313ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25102025-08-28T21:46:27.313ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
25112025-08-28T21:46:27.313ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25122025-08-28T21:46:27.314ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
25132025-08-28T21:46:27.314ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
25142025-08-28T21:46:27.314ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
25152025-08-28T21:46:27.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = bfd_manager resource = Database result = Ok(())
25162025-08-28T21:46:27.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
25172025-08-28T21:46:27.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25182025-08-28T21:46:27.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25192025-08-28T21:46:27.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
25202025-08-28T21:46:27.314ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("29f5e375-8d13-490a-8d8c-25abbffb62fc.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f7509ee4-501a-451c-a026-2b7946c79d73.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f7509ee4-501a-451c-a026-2b7946c79d73.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1755, tv_nsec: 846394536 } })
25212025-08-28T21:46:27.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
25222025-08-28T21:46:27.314ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("34926ba2-743e-40ae-813d-5f114d8a9912.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3683ed2f-b132-4612-ad98-adc9a748bc7e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e7031451-4fb4-459c-889a-f39ec3c49e88.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("e7031451-4fb4-459c-889a-f39ec3c49e88.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 1755, tv_nsec: 846584801 } })
25232025-08-28T21:46:27.314ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
25242025-08-28T21:46:27.314ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.092298ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
25252025-08-28T21:46:27.315ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
25262025-08-28T21:46:27.315ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.252903ms iteration = 15 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
25272025-08-28T21:46:27.315ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25282025-08-28T21:46:27.315ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25292025-08-28T21:46:27.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25302025-08-28T21:46:27.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25312025-08-28T21:46:27.316ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25322025-08-28T21:46:27.316ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1755, tv_nsec: 848440429 } })
25332025-08-28T21:46:27.316ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_garbage_collector file = nexus/src/app/mod.rs:1205
25342025-08-28T21:46:27.317ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-28 21:36:27.313796020 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
25352025-08-28T21:46:27.317ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.47497ms iteration = 14 status = {"expiration":"2025-08-28T21:36:27.313796020Z","pruned":[]}
25362025-08-28T21:46:27.317ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25372025-08-28T21:46:27.317ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1755, tv_nsec: 849423735 } })
25382025-08-28T21:46:27.317ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25392025-08-28T21:46:27.317ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1205
25402025-08-28T21:46:27.317ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.88534ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
25412025-08-28T21:46:27.318ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
25422025-08-28T21:46:27.318ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25432025-08-28T21:46:27.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
25442025-08-28T21:46:27.321ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25452025-08-28T21:46:27.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
25462025-08-28T21:46:27.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25472025-08-28T21:46:27.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25482025-08-28T21:46:27.322ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25492025-08-28T21:46:27.322ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
25502025-08-28T21:46:27.323ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
25512025-08-28T21:46:27.323ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
25522025-08-28T21:46:27.323ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25532025-08-28T21:46:27.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25542025-08-28T21:46:27.324ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25552025-08-28T21:46:27.325ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
25562025-08-28T21:46:27.325ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25572025-08-28T21:46:27.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
25582025-08-28T21:46:27.327ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25592025-08-28T21:46:27.327ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25602025-08-28T21:46:27.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25612025-08-28T21:46:27.328ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25622025-08-28T21:46:27.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
25632025-08-28T21:46:27.329ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 19 reason = Timeout
25642025-08-28T21:46:27.329ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
25652025-08-28T21:46:27.329ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
25662025-08-28T21:46:27.329ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
25672025-08-28T21:46:27.329ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 18.69\u{b5}s iteration = 19 status = "Disabled"
25682025-08-28T21:46:27.329ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
25692025-08-28T21:46:27.329ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
25702025-08-28T21:46:27.329ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 00f179d2-0574-4e49-85ff-8736d21b9fd1 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
25712025-08-28T21:46:27.329ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25722025-08-28T21:46:27.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
25732025-08-28T21:46:27.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25742025-08-28T21:46:27.329ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25752025-08-28T21:46:27.330ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25762025-08-28T21:46:27.330ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25772025-08-28T21:46:27.332ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
25782025-08-28T21:46:27.332ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25792025-08-28T21:46:27.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
25802025-08-28T21:46:27.333ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
25812025-08-28T21:46:27.333ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
25822025-08-28T21:46:27.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
25832025-08-28T21:46:27.334ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25842025-08-28T21:46:27.334ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25852025-08-28T21:46:27.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25862025-08-28T21:46:27.336ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 00f179d2-0574-4e49-85ff-8736d21b9fd1 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
25872025-08-28T21:46:27.336ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
25882025-08-28T21:46:27.336ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-28 21:34:04.777048 UTC dns_group = internal generation = 1
25892025-08-28T21:46:27.336ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 22.966756ms iteration = 15 status = {"generation":1}
25902025-08-28T21:46:27.340ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
25912025-08-28T21:46:27.340ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
25922025-08-28T21:46:27.340ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
25932025-08-28T21:46:27.340ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
25942025-08-28T21:46:27.340ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
25952025-08-28T21:46:27.340ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
25962025-08-28T21:46:27.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = lookup_region_port resource = Database result = Ok(())
25972025-08-28T21:46:27.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
25982025-08-28T21:46:27.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database result = Ok(())
25992025-08-28T21:46:27.343ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 2.757262ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
26002025-08-28T21:46:27.344ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
26012025-08-28T21:46:27.344ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
26022025-08-28T21:46:27.344ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 3.46399ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
26032025-08-28T21:46:27.348ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 14 reason = Timeout
26042025-08-28T21:46:27.348ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
26052025-08-28T21:46:27.348ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 14 reason = Timeout
26062025-08-28T21:46:27.348ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
26072025-08-28T21:46:27.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = webhook_deliverator resource = Database result = Ok(())
26082025-08-28T21:46:27.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database result = Ok(())
26092025-08-28T21:46:27.349ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
26102025-08-28T21:46:27.349ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 1.890559ms iteration = 14 status = {"by_rx":{},"error":null}
26112025-08-28T21:46:27.351ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
26122025-08-28T21:46:27.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database result = Ok(())
26132025-08-28T21:46:27.353ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 5.356329ms iteration = 14 status = {"dispatched":[],"errors":[],"glob_version":"183.0.0","globs_reprocessed":{},"no_receivers":[]}
26142025-08-28T21:46:27.357ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
26152025-08-28T21:46:27.357ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
26162025-08-28T21:46:27.357ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
26172025-08-28T21:46:27.357ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26182025-08-28T21:46:27.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26192025-08-28T21:46:27.359ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26202025-08-28T21:46:27.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
26212025-08-28T21:46:27.362ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26222025-08-28T21:46:27.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26232025-08-28T21:46:27.370ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
26242025-08-28T21:46:27.370ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
26252025-08-28T21:46:27.370ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 41.532707ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
26262025-08-28T21:46:27.380ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-28T21:33:21.286055Z, time_modified: 2025-08-28T21:33:21.286055Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, db_silo: Silo { identity: SiloIdentity { id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-28T21:34:05.369976Z, time_modified: 2025-08-28T21:34:05.369976Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b6acf240eb452c21e0b1e580a1d52c2797fabc391b3eb746647244649b18e959" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, db_silo: Silo { identity: SiloIdentity { id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-28T21:34:05.369976Z, time_modified: 2025-08-28T21:34:05.369976Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b6acf240eb452c21e0b1e580a1d52c2797fabc391b3eb746647244649b18e959" }] }) }
26272025-08-28T21:46:27.381ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 67.06797ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"427aaf87-3d8a-4dc0-888f-bfc71eaeae3f","tls_certs":["b6acf240eb452c21e0b1e580a1d52c2797fabc391b3eb746647244649b18e959"]}},"default_endpoint":{"silo_id":"427aaf87-3d8a-4dc0-888f-bfc71eaeae3f","tls_certs":["b6acf240eb452c21e0b1e580a1d52c2797fabc391b3eb746647244649b18e959"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
26282025-08-28T21:46:27.402ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
26292025-08-28T21:46:27.402ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = be33e1d0-e98d-462e-bd25-7cffb75dab02 dns_zone_name = oxide.test found_so_far = 0 version = 2
26302025-08-28T21:46:27.402ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26312025-08-28T21:46:27.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26322025-08-28T21:46:27.404ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26332025-08-28T21:46:27.407ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
26342025-08-28T21:46:27.407ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26352025-08-28T21:46:27.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26362025-08-28T21:46:27.409ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = be33e1d0-e98d-462e-bd25-7cffb75dab02 dns_zone_name = oxide.test found_so_far = 4 version = 2
26372025-08-28T21:46:27.409ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
26382025-08-28T21:46:27.409ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-28 21:34:05.486436 UTC dns_group = external generation = 2
26392025-08-28T21:46:27.409ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 95.906678ms iteration = 15 status = {"generation":2}
26402025-08-28T21:46:27.420ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
26412025-08-28T21:46:27.422ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
26422025-08-28T21:46:27.422ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_garbage_collector file = nexus/src/app/mod.rs:1213 zone_address = fd00:1122:3344:101::2
26432025-08-28T21:46:27.422ZDEBGnexus (MgsClient): client request background_task = nat_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26442025-08-28T21:46:27.423ZDEBGnexus (MgsClient): client response background_task = nat_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "123e953d-f857-4bee-99fd-3f15842a7de5", "content-length": "26", "date": "Thu, 28 Aug 2025 21:46:27 GMT"} })
26452025-08-28T21:46:27.423ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_garbage_collector file = nexus/src/app/mod.rs:1216 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26462025-08-28T21:46:27.424ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_garbage_collector file = nexus/src/app/mod.rs:1250 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26472025-08-28T21:46:27.425ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1213 zone_address = fd00:1122:3344:101::2
26482025-08-28T21:46:27.425ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26492025-08-28T21:46:27.425ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f54169ce-8ebc-4a1a-b99a-654256200cc9", "content-length": "26", "date": "Thu, 28 Aug 2025 21:46:27 GMT"} })
26502025-08-28T21:46:27.425ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1216 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26512025-08-28T21:46:27.427ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1250 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26522025-08-28T21:46:27.445ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 27 reason = Timeout
26532025-08-28T21:46:27.445ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 27 reason = Timeout
26542025-08-28T21:46:27.445ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 14.481\u{b5}s iteration = 27 status = {"disabled":true,"errors":[],"sps":[]}
26552025-08-28T21:46:27.445ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
26562025-08-28T21:46:27.445ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
26572025-08-28T21:46:27.445ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26582025-08-28T21:46:27.445ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
26592025-08-28T21:46:27.445ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 27 reason = Timeout
26602025-08-28T21:46:27.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26612025-08-28T21:46:27.445ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
26622025-08-28T21:46:27.445ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
26632025-08-28T21:46:27.445ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
26642025-08-28T21:46:27.445ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26652025-08-28T21:46:27.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
26662025-08-28T21:46:27.445ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
26672025-08-28T21:46:27.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26682025-08-28T21:46:27.445ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
26692025-08-28T21:46:27.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
26702025-08-28T21:46:27.445ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
26712025-08-28T21:46:27.445ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
26722025-08-28T21:46:27.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26732025-08-28T21:46:27.445ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
26742025-08-28T21:46:27.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
26752025-08-28T21:46:27.445ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
26762025-08-28T21:46:27.445ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
26772025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26782025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26792025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
26802025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26812025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
26822025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
26832025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26842025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
26852025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 157 reason = Timeout
26862025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26872025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
26882025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
26892025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26902025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26912025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
26922025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26932025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
26942025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26952025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
26962025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
26972025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
26982025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
26992025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27002025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
27012025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27022025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27032025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
27042025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
27052025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27062025-08-28T21:46:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
27072025-08-28T21:46:27.448ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27082025-08-28T21:46:27.448ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27092025-08-28T21:46:27.448ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27102025-08-28T21:46:27.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27112025-08-28T21:46:27.449ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27122025-08-28T21:46:27.449ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.393108ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
27132025-08-28T21:46:27.449ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27142025-08-28T21:46:27.449ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27152025-08-28T21:46:27.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27162025-08-28T21:46:27.453ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27172025-08-28T21:46:27.453ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27182025-08-28T21:46:27.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27192025-08-28T21:46:27.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
27202025-08-28T21:46:27.453ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27212025-08-28T21:46:27.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
27222025-08-28T21:46:27.454ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
27232025-08-28T21:46:27.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27242025-08-28T21:46:27.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
27252025-08-28T21:46:27.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
27262025-08-28T21:46:27.454ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
27272025-08-28T21:46:27.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27282025-08-28T21:46:27.454ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27292025-08-28T21:46:27.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
27302025-08-28T21:46:27.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27312025-08-28T21:46:27.455ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27322025-08-28T21:46:27.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27332025-08-28T21:46:27.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27342025-08-28T21:46:27.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
27352025-08-28T21:46:27.457ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1755, tv_nsec: 989398165 } })
27362025-08-28T21:46:27.457ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
27372025-08-28T21:46:27.457ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 11.604731ms iteration = 157 status = {"chicken_switches_updated":false}
27382025-08-28T21:46:27.457ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
27392025-08-28T21:46:27.457ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1205 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1
27402025-08-28T21:46:27.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
27412025-08-28T21:46:27.458ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27422025-08-28T21:46:27.458ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27432025-08-28T21:46:27.458ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27442025-08-28T21:46:27.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27452025-08-28T21:46:27.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27462025-08-28T21:46:27.458ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27472025-08-28T21:46:27.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
27482025-08-28T21:46:27.459ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27492025-08-28T21:46:27.460ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27502025-08-28T21:46:27.460ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27512025-08-28T21:46:27.463ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27522025-08-28T21:46:27.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
27532025-08-28T21:46:27.464ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
27542025-08-28T21:46:27.464ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
27552025-08-28T21:46:27.464ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27562025-08-28T21:46:27.464ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27572025-08-28T21:46:27.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
27582025-08-28T21:46:27.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27592025-08-28T21:46:27.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 75210457-5921-4367-8327-1fd4d2d66bd6, lookup_type: ById(75210457-5921-4367-8327-1fd4d2d66bd6) } result = Ok(())
27602025-08-28T21:46:27.465ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27612025-08-28T21:46:27.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
27622025-08-28T21:46:27.474ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27632025-08-28T21:46:27.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
27642025-08-28T21:46:27.476ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27652025-08-28T21:46:27.480ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27662025-08-28T21:46:27.480ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27672025-08-28T21:46:27.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
27682025-08-28T21:46:27.486ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27692025-08-28T21:46:27.489ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27702025-08-28T21:46:27.489ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27712025-08-28T21:46:27.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
27722025-08-28T21:46:27.502ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
27732025-08-28T21:46:27.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database result = Ok(())
27742025-08-28T21:46:27.516ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27752025-08-28T21:46:27.516ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
27762025-08-28T21:46:27.516ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27772025-08-28T21:46:27.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
27782025-08-28T21:46:27.523ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27792025-08-28T21:46:27.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
27802025-08-28T21:46:27.529ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27812025-08-28T21:46:27.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
27822025-08-28T21:46:27.529ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 83.417104ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
27832025-08-28T21:46:27.529ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 83.636039ms iteration = 27 status = {"errors":[],"requests_created_ok":[]}
27842025-08-28T21:46:27.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27852025-08-28T21:46:27.531ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 original_time_created = 2025-08-28 21:33:17.370599 UTC target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 time_created = 2025-08-28 21:33:17.370599 UTC
27862025-08-28T21:46:27.531ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 85.561719ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"75210457-5921-4367-8327-1fd4d2d66bd6","time_created":"2025-08-28T21:33:17.370599Z"}
27872025-08-28T21:46:27.535ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
27882025-08-28T21:46:27.535ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27892025-08-28T21:46:27.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27902025-08-28T21:46:27.536ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27912025-08-28T21:46:27.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Fleet result = Ok(())
27922025-08-28T21:46:27.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27932025-08-28T21:46:27.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
27942025-08-28T21:46:27.540ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 94.221754ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27952025-08-28T21:46:27.540ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27962025-08-28T21:46:27.540ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
27972025-08-28T21:46:27.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27982025-08-28T21:46:27.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
27992025-08-28T21:46:27.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28002025-08-28T21:46:27.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28012025-08-28T21:46:27.541ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28022025-08-28T21:46:27.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28032025-08-28T21:46:27.570ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 124.390237ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
28042025-08-28T21:46:27.598ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
28052025-08-28T21:46:27.598ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 152.571917ms iteration = 27 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
28062025-08-28T21:46:27.602ZDEBGnexus (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
28072025-08-28T21:46:27.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
28082025-08-28T21:46:27.615ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_garbage_collector elapsed = 302.010344ms iteration = 27 status = null
28092025-08-28T21:46:27.626ZINFOnexus (BackgroundTasks): VPC route manager sled af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
28102025-08-28T21:46:27.626ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28112025-08-28T21:46:27.626ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
28122025-08-28T21:46:27.629ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "02fef92f-9ff2-47c1-8e9f-deb6f729a866", "content-length": "372", "date": "Thu, 28 Aug 2025 21:46:27 GMT"} })
28132025-08-28T21:46:27.629ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28142025-08-28T21:46:27.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28152025-08-28T21:46:27.630ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 184.582858ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28162025-08-28T21:46:27.640ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28172025-08-28T21:46:27.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28182025-08-28T21:46:27.641ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28192025-08-28T21:46:27.641ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
28202025-08-28T21:46:27.641ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 195.557202ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
28212025-08-28T21:46:27.662ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
28222025-08-28T21:46:27.662ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
28232025-08-28T21:46:27.662ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4d9f0fb0-2edc-46f7-a620-5836c27b7c14", "date": "Thu, 28 Aug 2025 21:46:27 GMT"} })
28242025-08-28T21:46:27.662ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28252025-08-28T21:46:27.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28262025-08-28T21:46:27.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28272025-08-28T21:46:27.665ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
28282025-08-28T21:46:27.665ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 219.934115ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
28292025-08-28T21:46:27.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28302025-08-28T21:46:27.670ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28312025-08-28T21:46:27.670ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 356.737233ms iteration = 27 status = {}
28322025-08-28T21:46:27.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28332025-08-28T21:46:27.674ZINFOnexus (BackgroundTasks): VPC route manager sled af8277ed-838c-4274-8629-14eae35fd0e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
28342025-08-28T21:46:27.674ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28352025-08-28T21:46:27.675ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "df68fed4-c4a9-41eb-bbfe-74619575ca8e", "date": "Thu, 28 Aug 2025 21:46:27 GMT"} })
28362025-08-28T21:46:27.679ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 233.574448ms iteration = 32 status = {}
28372025-08-28T21:46:27.686ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28382025-08-28T21:46:27.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28392025-08-28T21:46:27.692ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = d4239575-c5b3-439f-b0c1-b7b33b46fc73 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
28402025-08-28T21:46:27.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = d4239575-c5b3-439f-b0c1-b7b33b46fc73 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
28412025-08-28T21:46:27.696ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28422025-08-28T21:46:27.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 3341 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = d4239575-c5b3-439f-b0c1-b7b33b46fc73 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
28432025-08-28T21:46:27.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28442025-08-28T21:46:27.698ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 252.969432ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
28452025-08-28T21:46:27.699ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28462025-08-28T21:46:27.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: af8277ed-838c-4274-8629-14eae35fd0e4, lookup_type: ById(af8277ed-838c-4274-8629-14eae35fd0e4) } result = Ok(())
28472025-08-28T21:46:27.702ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28482025-08-28T21:46:27.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28492025-08-28T21:46:27.704ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 258.634568ms iteration = 27 status = 0
28502025-08-28T21:46:27.721ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
28512025-08-28T21:46:27.721ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "81126fb4-3d7c-49ca-9617-016e9b623956", "date": "Thu, 28 Aug 2025 21:46:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28522025-08-28T21:46:27.721ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28532025-08-28T21:46:27.723ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "8a6447af-8033-4e93-ada7-b02e36fabfcd", "date": "Thu, 28 Aug 2025 21:46:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28542025-08-28T21:46:27.723ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28552025-08-28T21:46:27.725ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28562025-08-28T21:46:27.725ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 411.680458ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
28572025-08-28T21:46:27.731ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 285.443154ms iteration = 31 status = {"physical_disks_added":0}
28582025-08-28T21:46:27.735ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
28592025-08-28T21:46:27.735ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d342a64f-207d-4188-816d-590a1d832831", "content-length": "691", "date": "Thu, 28 Aug 2025 21:46:27 GMT"} })
28602025-08-28T21:46:27.735ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
28612025-08-28T21:46:27.735ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
28622025-08-28T21:46:27.735ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
28632025-08-28T21:46:27.737ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 291.661925ms iteration = 30 status = {}
28642025-08-28T21:46:27.746ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
28652025-08-28T21:46:27.746ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 405.437846ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
28662025-08-28T21:46:27.800ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1213 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 zone_address = fd00:1122:3344:101::2
28672025-08-28T21:46:27.800ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28682025-08-28T21:46:27.800ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
28692025-08-28T21:46:27.800ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d69debd6-e2f9-43b1-9c19-737fccf8f16b", "content-length": "26", "date": "Thu, 28 Aug 2025 21:46:26 GMT"} })
28702025-08-28T21:46:27.800ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1216 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28712025-08-28T21:46:27.800ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "92731801-5681-41da-b659-900b361ff3ab", "date": "Thu, 28 Aug 2025 21:46:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
28722025-08-28T21:46:27.800ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
28732025-08-28T21:46:27.801ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "932062fc-950d-4977-9299-16a0adf91a09", "date": "Thu, 28 Aug 2025 21:46:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
28742025-08-28T21:46:27.801ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
28752025-08-28T21:46:27.802ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1250 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1
28762025-08-28T21:46:27.803ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a927f1c6-08c0-466e-bfa9-95199fc7ac2e", "date": "Thu, 28 Aug 2025 21:46:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
28772025-08-28T21:46:27.803ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
28782025-08-28T21:46:27.805ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
28792025-08-28T21:46:27.805ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 491.462088ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
28802025-08-28T21:46:27.913ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28812025-08-28T21:46:27.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28822025-08-28T21:46:27.916ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 00cfe4f2-9fed-42f3-bd7c-dbdf1ed57d5e, rack_id: 8a92b2f1-f565-4a24-a10f-f55b1f446cc1, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(c2e57029-848b-4db2-bb2f-4a9b47d7bf41) } rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 switch_location = Switch0
28832025-08-28T21:46:27.916ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28842025-08-28T21:46:27.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28852025-08-28T21:46:27.930ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
28862025-08-28T21:46:27.930ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = c2e57029-848b-4db2-bb2f-4a9b47d7bf41
28872025-08-28T21:46:27.930ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
28882025-08-28T21:46:27.930ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
28892025-08-28T21:46:27.930ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28902025-08-28T21:46:27.930ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28912025-08-28T21:46:27.930ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28922025-08-28T21:46:27.930ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28932025-08-28T21:46:27.931ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28942025-08-28T21:46:27.931ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28952025-08-28T21:46:27.931ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1
28962025-08-28T21:46:27.931ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28972025-08-28T21:46:27.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28982025-08-28T21:46:27.933ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 switch_location = Switch0
28992025-08-28T21:46:27.933ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
29002025-08-28T21:46:28.052ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "26d16fe6-66b0-4360-a280-dfa5c4ee8317", "date": "Thu, 28 Aug 2025 21:46:27 GMT"} })
29012025-08-28T21:46:28.052ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 switch = Switch0
29022025-08-28T21:46:28.052ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
29032025-08-28T21:46:28.059ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "641c3d77-4074-4906-867e-f9badfdaee2f", "content-length": "682", "date": "Thu, 28 Aug 2025 21:46:27 GMT"} })
29042025-08-28T21:46:28.059ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29052025-08-28T21:46:28.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29062025-08-28T21:46:28.063ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29072025-08-28T21:46:28.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29082025-08-28T21:46:28.066ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29092025-08-28T21:46:28.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29102025-08-28T21:46:28.069ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29112025-08-28T21:46:28.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29122025-08-28T21:46:28.076ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 630.437923ms iteration = 27 status = {}
29132025-08-28T21:46:28.714ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 7e43c4e5-1847-453d-9263-56e92239f3db roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
29142025-08-28T21:46:28.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 7e43c4e5-1847-453d-9263-56e92239f3db resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
29152025-08-28T21:46:28.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2311 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 7e43c4e5-1847-453d-9263-56e92239f3db response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
29162025-08-28T21:46:29.730ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 49cc1a69-60e2-4ce7-a59e-c74451cc90c4 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
29172025-08-28T21:46:29.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 49cc1a69-60e2-4ce7-a59e-c74451cc90c4 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
29182025-08-28T21:46:29.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2202 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 49cc1a69-60e2-4ce7-a59e-c74451cc90c4 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
29192025-08-28T21:46:29.892ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2428 local_addr = [fd00:1122:3344:101::a]:41821 method = GET remote_addr = [fd00:1122:3344:101::d]:45939 req_id = 30370366-0f73-41c2-bbd2-fa44b9bd46c6 response_code = 200 uri = /0fe4e55a-5967-4507-9554-6c41366055df
29202025-08-28T21:46:30.746ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 5df5b469-a292-4f8d-9f47-1d50ddbf715a roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
29212025-08-28T21:46:30.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 5df5b469-a292-4f8d-9f47-1d50ddbf715a resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
29222025-08-28T21:46:30.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2162 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 5df5b469-a292-4f8d-9f47-1d50ddbf715a response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
29232025-08-28T21:46:31.763ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = fdf97125-807d-4552-8cfa-8ea5bbb97b56 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
29242025-08-28T21:46:31.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = fdf97125-807d-4552-8cfa-8ea5bbb97b56 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
29252025-08-28T21:46:31.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2785 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = fdf97125-807d-4552-8cfa-8ea5bbb97b56 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
29262025-08-28T21:46:32.446ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 158 reason = Timeout
29272025-08-28T21:46:32.446ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
29282025-08-28T21:46:32.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
29292025-08-28T21:46:32.448ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29302025-08-28T21:46:32.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
29312025-08-28T21:46:32.451ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
29322025-08-28T21:46:32.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
29332025-08-28T21:46:32.453ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
29342025-08-28T21:46:32.453ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.692669ms iteration = 158 status = {"chicken_switches_updated":false}
29352025-08-28T21:46:32.780ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = f696ce41-b7f3-412a-9c44-aa80aca3d56b roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
29362025-08-28T21:46:32.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = f696ce41-b7f3-412a-9c44-aa80aca3d56b resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
29372025-08-28T21:46:32.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2381 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = f696ce41-b7f3-412a-9c44-aa80aca3d56b response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
29382025-08-28T21:46:33.795ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 2776032f-8292-4393-a700-7a12c984a07e roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
29392025-08-28T21:46:33.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 2776032f-8292-4393-a700-7a12c984a07e resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
29402025-08-28T21:46:33.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2476 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 2776032f-8292-4393-a700-7a12c984a07e response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
29412025-08-28T21:46:34.587ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::2]:62030
29422025-08-28T21:46:34.587ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62030 req_id = 633d9537-bdb1-4c88-9c1b-96f7bb1bfbd3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100 user_builtin_id = 001de000-05e4-4000-8000-000000000002
29432025-08-28T21:46:34.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62030 req_id = 633d9537-bdb1-4c88-9c1b-96f7bb1bfbd3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100 user_builtin_id = 001de000-05e4-4000-8000-000000000002
29442025-08-28T21:46:34.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 3830 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62030 req_id = 633d9537-bdb1-4c88-9c1b-96f7bb1bfbd3 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
29452025-08-28T21:46:34.810ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = ac1f09ba-be7f-4726-b472-f6f68af3a2a0 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
29462025-08-28T21:46:34.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = ac1f09ba-be7f-4726-b472-f6f68af3a2a0 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
29472025-08-28T21:46:34.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 1966 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = ac1f09ba-be7f-4726-b472-f6f68af3a2a0 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
29482025-08-28T21:46:35.827ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 31cad8d9-d121-49ab-8fbe-1ece0644f316 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
29492025-08-28T21:46:35.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 31cad8d9-d121-49ab-8fbe-1ece0644f316 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
29502025-08-28T21:46:35.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2918 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 31cad8d9-d121-49ab-8fbe-1ece0644f316 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
29512025-08-28T21:46:36.639ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 5
29522025-08-28T21:46:36.639ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221
29532025-08-28T21:46:36.670ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
29542025-08-28T21:46:36.670ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:58334
29552025-08-28T21:46:36.670ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:58334 req_id = c9dd96f8-afd0-44eb-8bc7-3f04fd21c37f roles = RoleSet { roles: {} } uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
29562025-08-28T21:46:36.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:58334 req_id = c9dd96f8-afd0-44eb-8bc7-3f04fd21c37f resource = Database result = Ok(()) uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
29572025-08-28T21:46:36.681ZINFOnexus: assigned collector to new producer collector_id = fbcc3716-f2fd-4c7d-a691-c299da81c53f file = nexus/src/app/oximeter.rs:76 producer_id = 0fe4e55a-5967-4507-9554-6c41366055df
29582025-08-28T21:46:36.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 11033 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:58334 req_id = c9dd96f8-afd0-44eb-8bc7-3f04fd21c37f response_code = 201 uri = /metrics/producers
29592025-08-28T21:46:36.681ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "c9dd96f8-afd0-44eb-8bc7-3f04fd21c37f", "content-length": "41", "date": "Thu, 28 Aug 2025 21:46:35 GMT"} })
29602025-08-28T21:46:36.682ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
29612025-08-28T21:46:36.844ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 5494b456-9326-4ed7-b2d5-bd815dfdede9 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
29622025-08-28T21:46:36.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 5494b456-9326-4ed7-b2d5-bd815dfdede9 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
29632025-08-28T21:46:36.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2270 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 5494b456-9326-4ed7-b2d5-bd815dfdede9 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
29642025-08-28T21:46:37.445ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
29652025-08-28T21:46:37.446ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
29662025-08-28T21:46:37.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29672025-08-28T21:46:37.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29682025-08-28T21:46:37.446ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 159 reason = Timeout
29692025-08-28T21:46:37.446ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
29702025-08-28T21:46:37.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29712025-08-28T21:46:37.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
29722025-08-28T21:46:37.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
29732025-08-28T21:46:37.448ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29742025-08-28T21:46:37.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29752025-08-28T21:46:37.448ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29762025-08-28T21:46:37.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29772025-08-28T21:46:37.450ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.794925ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29782025-08-28T21:46:37.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29792025-08-28T21:46:37.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29802025-08-28T21:46:37.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
29812025-08-28T21:46:37.451ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
29822025-08-28T21:46:37.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
29832025-08-28T21:46:37.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
29842025-08-28T21:46:37.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29852025-08-28T21:46:37.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
29862025-08-28T21:46:37.453ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
29872025-08-28T21:46:37.453ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.882375ms iteration = 159 status = {"chicken_switches_updated":false}
29882025-08-28T21:46:37.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29892025-08-28T21:46:37.457ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 75210457-5921-4367-8327-1fd4d2d66bd6, lookup_type: ById(75210457-5921-4367-8327-1fd4d2d66bd6) } result = Ok(())
29902025-08-28T21:46:37.457ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29912025-08-28T21:46:37.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
29922025-08-28T21:46:37.476ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 original_time_created = 2025-08-28 21:33:17.370599 UTC target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 time_created = 2025-08-28 21:33:17.370599 UTC
29932025-08-28T21:46:37.476ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.43564ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"75210457-5921-4367-8327-1fd4d2d66bd6","time_created":"2025-08-28T21:33:17.370599Z"}
29942025-08-28T21:46:37.860ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 2020eb92-f54a-43ef-a168-e0254aa6e212 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
29952025-08-28T21:46:37.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 2020eb92-f54a-43ef-a168-e0254aa6e212 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
29962025-08-28T21:46:37.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2333 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 2020eb92-f54a-43ef-a168-e0254aa6e212 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
29972025-08-28T21:46:38.875ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 7db5a083-4131-4432-aea8-eb4d2f1f75dd roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
29982025-08-28T21:46:38.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 7db5a083-4131-4432-aea8-eb4d2f1f75dd resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
29992025-08-28T21:46:38.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2377 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 7db5a083-4131-4432-aea8-eb4d2f1f75dd response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
30002025-08-28T21:46:39.891ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = fe22a440-fd02-43af-9f69-389e06ff9fa6 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30012025-08-28T21:46:39.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = fe22a440-fd02-43af-9f69-389e06ff9fa6 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30022025-08-28T21:46:39.892ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2480 local_addr = [fd00:1122:3344:101::a]:41821 method = GET remote_addr = [fd00:1122:3344:101::d]:45939 req_id = bc8cefe7-1a02-40d1-a115-41061c9f70d7 response_code = 200 uri = /0fe4e55a-5967-4507-9554-6c41366055df
30032025-08-28T21:46:39.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2466 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = fe22a440-fd02-43af-9f69-389e06ff9fa6 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
30042025-08-28T21:46:40.906ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 8ecb105b-66be-4b37-8cea-87ec5e1bc89c roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30052025-08-28T21:46:40.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 8ecb105b-66be-4b37-8cea-87ec5e1bc89c resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30062025-08-28T21:46:40.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2254 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 8ecb105b-66be-4b37-8cea-87ec5e1bc89c response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
30072025-08-28T21:46:41.922ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = af7beb7e-a802-4222-9665-b52ca402e00a roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30082025-08-28T21:46:41.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = af7beb7e-a802-4222-9665-b52ca402e00a resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30092025-08-28T21:46:41.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2572 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = af7beb7e-a802-4222-9665-b52ca402e00a response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
30102025-08-28T21:46:42.446ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 160 reason = Timeout
30112025-08-28T21:46:42.446ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
30122025-08-28T21:46:42.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
30132025-08-28T21:46:42.449ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30142025-08-28T21:46:42.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
30152025-08-28T21:46:42.452ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
30162025-08-28T21:46:42.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
30172025-08-28T21:46:42.455ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
30182025-08-28T21:46:42.455ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.933221ms iteration = 160 status = {"chicken_switches_updated":false}
30192025-08-28T21:46:42.939ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = eb730e8c-1670-42d1-870f-f02de381c030 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30202025-08-28T21:46:42.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = eb730e8c-1670-42d1-870f-f02de381c030 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30212025-08-28T21:46:42.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2795 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = eb730e8c-1670-42d1-870f-f02de381c030 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
30222025-08-28T21:46:43.954ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = dddc1ca9-83ba-4744-adc4-f45eca1b4cfc roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30232025-08-28T21:46:43.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = dddc1ca9-83ba-4744-adc4-f45eca1b4cfc resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30242025-08-28T21:46:43.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2336 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = dddc1ca9-83ba-4744-adc4-f45eca1b4cfc response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
30252025-08-28T21:46:44.969ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 9a2d3b1c-37de-4c12-a980-dbc8821a81b2 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30262025-08-28T21:46:44.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 9a2d3b1c-37de-4c12-a980-dbc8821a81b2 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30272025-08-28T21:46:44.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2300 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 9a2d3b1c-37de-4c12-a980-dbc8821a81b2 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
30282025-08-28T21:46:45.986ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 2e0da072-9386-40c3-a63c-ff72a9b4f3d7 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30292025-08-28T21:46:45.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 2e0da072-9386-40c3-a63c-ff72a9b4f3d7 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30302025-08-28T21:46:45.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2571 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 2e0da072-9386-40c3-a63c-ff72a9b4f3d7 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
30312025-08-28T21:46:47.002ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = c3eefb6e-1c79-423e-80d9-930e6a013337 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30322025-08-28T21:46:47.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = c3eefb6e-1c79-423e-80d9-930e6a013337 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30332025-08-28T21:46:47.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2505 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = c3eefb6e-1c79-423e-80d9-930e6a013337 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
30342025-08-28T21:46:47.446ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
30352025-08-28T21:46:47.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30362025-08-28T21:46:47.446ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
30372025-08-28T21:46:47.446ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 161 reason = Timeout
30382025-08-28T21:46:47.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30392025-08-28T21:46:47.446ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
30402025-08-28T21:46:47.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
30412025-08-28T21:46:47.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
30422025-08-28T21:46:47.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30432025-08-28T21:46:47.448ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30442025-08-28T21:46:47.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30452025-08-28T21:46:47.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30462025-08-28T21:46:47.449ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30472025-08-28T21:46:47.450ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.935902ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30482025-08-28T21:46:47.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30492025-08-28T21:46:47.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30502025-08-28T21:46:47.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
30512025-08-28T21:46:47.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
30522025-08-28T21:46:47.452ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
30532025-08-28T21:46:47.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
30542025-08-28T21:46:47.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30552025-08-28T21:46:47.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
30562025-08-28T21:46:47.454ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
30572025-08-28T21:46:47.454ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.848383ms iteration = 161 status = {"chicken_switches_updated":false}
30582025-08-28T21:46:47.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30592025-08-28T21:46:47.457ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 75210457-5921-4367-8327-1fd4d2d66bd6, lookup_type: ById(75210457-5921-4367-8327-1fd4d2d66bd6) } result = Ok(())
30602025-08-28T21:46:47.457ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30612025-08-28T21:46:47.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
30622025-08-28T21:46:47.471ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 original_time_created = 2025-08-28 21:33:17.370599 UTC target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 time_created = 2025-08-28 21:33:17.370599 UTC
30632025-08-28T21:46:47.471ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.950637ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"75210457-5921-4367-8327-1fd4d2d66bd6","time_created":"2025-08-28T21:33:17.370599Z"}
30642025-08-28T21:46:48.018ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = ac2874bc-e81b-44c9-98d1-25d186254efc roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30652025-08-28T21:46:48.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = ac2874bc-e81b-44c9-98d1-25d186254efc resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30662025-08-28T21:46:48.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2557 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = ac2874bc-e81b-44c9-98d1-25d186254efc response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
30672025-08-28T21:46:49.034ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6eb06bc3-33b5-404e-90c5-1ffc70116e57 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30682025-08-28T21:46:49.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6eb06bc3-33b5-404e-90c5-1ffc70116e57 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30692025-08-28T21:46:49.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2739 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6eb06bc3-33b5-404e-90c5-1ffc70116e57 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
30702025-08-28T21:46:49.892ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2590 local_addr = [fd00:1122:3344:101::a]:41821 method = GET remote_addr = [fd00:1122:3344:101::d]:45939 req_id = c9b21b1f-6db8-461d-8995-6af6865b1e63 response_code = 200 uri = /0fe4e55a-5967-4507-9554-6c41366055df
30712025-08-28T21:46:50.049ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = eaf4c6a0-0481-4a74-b8b1-e712cc140e1c roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30722025-08-28T21:46:50.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = eaf4c6a0-0481-4a74-b8b1-e712cc140e1c resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30732025-08-28T21:46:50.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2582 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = eaf4c6a0-0481-4a74-b8b1-e712cc140e1c response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
30742025-08-28T21:46:51.065ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 3d091d84-8d02-4e29-b68d-975cb2c56419 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30752025-08-28T21:46:51.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 3d091d84-8d02-4e29-b68d-975cb2c56419 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30762025-08-28T21:46:51.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2353 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 3d091d84-8d02-4e29-b68d-975cb2c56419 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
30772025-08-28T21:46:52.081ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 0f3289c0-a525-4c03-91c4-27d34f411a0d roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30782025-08-28T21:46:52.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 0f3289c0-a525-4c03-91c4-27d34f411a0d resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30792025-08-28T21:46:52.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2708 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 0f3289c0-a525-4c03-91c4-27d34f411a0d response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
30802025-08-28T21:46:52.445ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 162 reason = Timeout
30812025-08-28T21:46:52.445ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
30822025-08-28T21:46:52.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
30832025-08-28T21:46:52.448ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30842025-08-28T21:46:52.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
30852025-08-28T21:46:52.451ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
30862025-08-28T21:46:52.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
30872025-08-28T21:46:52.453ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
30882025-08-28T21:46:52.453ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.164582ms iteration = 162 status = {"chicken_switches_updated":false}
30892025-08-28T21:46:53.098ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = d4439c7f-4a17-47a5-9d7f-288baecdf5ea roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30902025-08-28T21:46:53.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = d4439c7f-4a17-47a5-9d7f-288baecdf5ea resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30912025-08-28T21:46:53.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2712 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = d4439c7f-4a17-47a5-9d7f-288baecdf5ea response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
30922025-08-28T21:46:54.115ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 4ac898ac-9625-4dc4-a9fd-524e0a4bea9b roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30932025-08-28T21:46:54.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 4ac898ac-9625-4dc4-a9fd-524e0a4bea9b resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30942025-08-28T21:46:54.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2042 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 4ac898ac-9625-4dc4-a9fd-524e0a4bea9b response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
30952025-08-28T21:46:55.131ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 80fb7d0b-3042-4348-87d7-a2938924d066 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30962025-08-28T21:46:55.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 80fb7d0b-3042-4348-87d7-a2938924d066 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30972025-08-28T21:46:55.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2591 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 80fb7d0b-3042-4348-87d7-a2938924d066 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
30982025-08-28T21:46:56.147ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 441b6549-76eb-4ad5-b5d2-ab4dd78b383d roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
30992025-08-28T21:46:56.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 441b6549-76eb-4ad5-b5d2-ab4dd78b383d resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
31002025-08-28T21:46:56.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2467 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 441b6549-76eb-4ad5-b5d2-ab4dd78b383d response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
31012025-08-28T21:46:57.164ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = c82ca3c7-3731-4ebc-a3da-46e1f069463d roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
31022025-08-28T21:46:57.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = c82ca3c7-3731-4ebc-a3da-46e1f069463d resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
31032025-08-28T21:46:57.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2663 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = c82ca3c7-3731-4ebc-a3da-46e1f069463d response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
31042025-08-28T21:46:57.313ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
31052025-08-28T21:46:57.313ZDEBGnexus (BackgroundTasks): activating background_task = nat_garbage_collector iteration = 28 reason = Timeout
31062025-08-28T21:46:57.313ZDEBGnexus (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
31072025-08-28T21:46:57.314ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
31082025-08-28T21:46:57.314ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
31092025-08-28T21:46:57.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
31102025-08-28T21:46:57.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = bfd_manager resource = Database result = Ok(())
31112025-08-28T21:46:57.316ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1785, tv_nsec: 848974935 } })
31122025-08-28T21:46:57.316ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1785, tv_nsec: 849047057 } })
31132025-08-28T21:46:57.317ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_garbage_collector file = nexus/src/app/mod.rs:1205
31142025-08-28T21:46:57.318ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.437876ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
31152025-08-28T21:46:57.318ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1205
31162025-08-28T21:46:57.354ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_garbage_collector file = nexus/src/app/mod.rs:1213 zone_address = fd00:1122:3344:101::2
31172025-08-28T21:46:57.354ZDEBGnexus (MgsClient): client request background_task = nat_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31182025-08-28T21:46:57.354ZDEBGnexus (MgsClient): client response background_task = nat_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "023fdfbe-e772-4cc0-b1c5-222866f68fed", "content-length": "26", "date": "Thu, 28 Aug 2025 21:46:56 GMT"} })
31192025-08-28T21:46:57.354ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_garbage_collector file = nexus/src/app/mod.rs:1216 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31202025-08-28T21:46:57.354ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1213 zone_address = fd00:1122:3344:101::2
31212025-08-28T21:46:57.354ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31222025-08-28T21:46:57.355ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0dd5e856-54de-47ef-a7f8-e9bcadd97747", "content-length": "26", "date": "Thu, 28 Aug 2025 21:46:56 GMT"} })
31232025-08-28T21:46:57.355ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1216 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31242025-08-28T21:46:57.355ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1250 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31252025-08-28T21:46:57.357ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_garbage_collector file = nexus/src/app/mod.rs:1250 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31262025-08-28T21:46:57.416ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 102.271223ms iteration = 28 status = {}
31272025-08-28T21:46:57.417ZDEBGnexus (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
31282025-08-28T21:46:57.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
31292025-08-28T21:46:57.420ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_garbage_collector elapsed = 106.463741ms iteration = 28 status = null
31302025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
31312025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 33 reason = Timeout
31322025-08-28T21:46:57.445ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
31332025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 28 reason = Timeout
31342025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31352025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31362025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
31372025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
31382025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
31392025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31402025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31412025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
31422025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
31432025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
31442025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31452025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 28 reason = Timeout
31462025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 9.94\u{b5}s iteration = 28 status = {"disabled":true,"errors":[],"sps":[]}
31472025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 28 reason = Timeout
31482025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
31492025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
31502025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
31512025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31522025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31532025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
31542025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
31552025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
31562025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
31572025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31582025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
31592025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31602025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
31612025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31622025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
31632025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
31642025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
31652025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31662025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 163 reason = Timeout
31672025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31682025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
31692025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31702025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
31712025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
31722025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31732025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
31742025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
31752025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31762025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31772025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31782025-08-28T21:46:57.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31792025-08-28T21:46:57.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
31802025-08-28T21:46:57.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
31812025-08-28T21:46:57.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31822025-08-28T21:46:57.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
31832025-08-28T21:46:57.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
31842025-08-28T21:46:57.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
31852025-08-28T21:46:57.447ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31862025-08-28T21:46:57.447ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31872025-08-28T21:46:57.447ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31882025-08-28T21:46:57.447ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31892025-08-28T21:46:57.447ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31902025-08-28T21:46:57.448ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31912025-08-28T21:46:57.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31922025-08-28T21:46:57.448ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31932025-08-28T21:46:57.448ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.848674ms iteration = 28 status = {"errors":[],"finish_invoked_ok":[]}
31942025-08-28T21:46:57.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31952025-08-28T21:46:57.448ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31962025-08-28T21:46:57.448ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
31972025-08-28T21:46:57.448ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31982025-08-28T21:46:57.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
31992025-08-28T21:46:57.450ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.770233ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32002025-08-28T21:46:57.450ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 5.644356ms iteration = 28 status = {"errors":[],"requests_created_ok":[]}
32012025-08-28T21:46:57.451ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32022025-08-28T21:46:57.451ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
32032025-08-28T21:46:57.451ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32042025-08-28T21:46:57.451ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32052025-08-28T21:46:57.451ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32062025-08-28T21:46:57.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
32072025-08-28T21:46:57.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32082025-08-28T21:46:57.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Fleet result = Ok(())
32092025-08-28T21:46:57.452ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32102025-08-28T21:46:57.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
32112025-08-28T21:46:57.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32122025-08-28T21:46:57.453ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32132025-08-28T21:46:57.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32142025-08-28T21:46:57.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
32152025-08-28T21:46:57.453ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
32162025-08-28T21:46:57.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
32172025-08-28T21:46:57.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
32182025-08-28T21:46:57.453ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
32192025-08-28T21:46:57.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
32202025-08-28T21:46:57.453ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32212025-08-28T21:46:57.453ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32222025-08-28T21:46:57.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
32232025-08-28T21:46:57.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32242025-08-28T21:46:57.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32252025-08-28T21:46:57.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32262025-08-28T21:46:57.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
32272025-08-28T21:46:57.455ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32282025-08-28T21:46:57.455ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
32292025-08-28T21:46:57.455ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 9.960328ms iteration = 163 status = {"chicken_switches_updated":false}
32302025-08-28T21:46:57.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32312025-08-28T21:46:57.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32322025-08-28T21:46:57.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
32332025-08-28T21:46:57.456ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1785, tv_nsec: 988714350 } })
32342025-08-28T21:46:57.456ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32352025-08-28T21:46:57.456ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1205 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1
32362025-08-28T21:46:57.457ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32372025-08-28T21:46:57.457ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32382025-08-28T21:46:57.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32392025-08-28T21:46:57.457ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32402025-08-28T21:46:57.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32412025-08-28T21:46:57.459ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32422025-08-28T21:46:57.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32432025-08-28T21:46:57.461ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 75210457-5921-4367-8327-1fd4d2d66bd6, lookup_type: ById(75210457-5921-4367-8327-1fd4d2d66bd6) } result = Ok(())
32442025-08-28T21:46:57.461ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32452025-08-28T21:46:57.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
32462025-08-28T21:46:57.465ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
32472025-08-28T21:46:57.465ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 20.086711ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
32482025-08-28T21:46:57.483ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 original_time_created = 2025-08-28 21:33:17.370599 UTC target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 time_created = 2025-08-28 21:33:17.370599 UTC
32492025-08-28T21:46:57.483ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 37.610576ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"75210457-5921-4367-8327-1fd4d2d66bd6","time_created":"2025-08-28T21:33:17.370599Z"}
32502025-08-28T21:46:57.485ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32512025-08-28T21:46:57.486ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32522025-08-28T21:46:57.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32532025-08-28T21:46:57.487ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32542025-08-28T21:46:57.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32552025-08-28T21:46:57.488ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
32562025-08-28T21:46:57.488ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32572025-08-28T21:46:57.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32582025-08-28T21:46:57.490ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32592025-08-28T21:46:57.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32602025-08-28T21:46:57.491ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 45.657165ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
32612025-08-28T21:46:57.491ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32622025-08-28T21:46:57.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
32632025-08-28T21:46:57.493ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 48.472988ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
32642025-08-28T21:46:57.494ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1213 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 zone_address = fd00:1122:3344:101::2
32652025-08-28T21:46:57.494ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32662025-08-28T21:46:57.495ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "452a0ff4-1f6a-4011-b8c4-a852915c0692", "content-length": "26", "date": "Thu, 28 Aug 2025 21:46:56 GMT"} })
32672025-08-28T21:46:57.495ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1216 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32682025-08-28T21:46:57.497ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32692025-08-28T21:46:57.497ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
32702025-08-28T21:46:57.497ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 51.913586ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
32712025-08-28T21:46:57.497ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1250 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1
32722025-08-28T21:46:57.501ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
32732025-08-28T21:46:57.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
32742025-08-28T21:46:57.508ZINFOnexus (BackgroundTasks): VPC route manager sled af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
32752025-08-28T21:46:57.508ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32762025-08-28T21:46:57.509ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbbcf22b-744a-424c-8df9-d3d08774bebc", "content-length": "372", "date": "Thu, 28 Aug 2025 21:46:57 GMT"} })
32772025-08-28T21:46:57.509ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32782025-08-28T21:46:57.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32792025-08-28T21:46:57.557ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 111.631375ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
32802025-08-28T21:46:57.562ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32812025-08-28T21:46:57.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32822025-08-28T21:46:57.565ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 120.26062ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
32832025-08-28T21:46:57.573ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32842025-08-28T21:46:57.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32852025-08-28T21:46:57.577ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32862025-08-28T21:46:57.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32872025-08-28T21:46:57.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32882025-08-28T21:46:57.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: af8277ed-838c-4274-8629-14eae35fd0e4, lookup_type: ById(af8277ed-838c-4274-8629-14eae35fd0e4) } result = Ok(())
32892025-08-28T21:46:57.585ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32902025-08-28T21:46:57.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32912025-08-28T21:46:57.587ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 142.24077ms iteration = 28 status = 0
32922025-08-28T21:46:57.594ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32932025-08-28T21:46:57.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
32942025-08-28T21:46:57.597ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
32952025-08-28T21:46:57.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
32962025-08-28T21:46:57.601ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
32972025-08-28T21:46:57.601ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
32982025-08-28T21:46:57.601ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "89f47b76-35ec-4d85-8c6a-9b9bbb367361", "date": "Thu, 28 Aug 2025 21:46:57 GMT"} })
32992025-08-28T21:46:57.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33002025-08-28T21:46:57.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33012025-08-28T21:46:57.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33022025-08-28T21:46:57.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33032025-08-28T21:46:57.608ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33042025-08-28T21:46:57.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33052025-08-28T21:46:57.612ZINFOnexus (BackgroundTasks): VPC route manager sled af8277ed-838c-4274-8629-14eae35fd0e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
33062025-08-28T21:46:57.612ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33072025-08-28T21:46:57.613ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2ee86fff-9e89-428e-8893-44da0d81a58a", "date": "Thu, 28 Aug 2025 21:46:57 GMT"} })
33082025-08-28T21:46:57.614ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 169.650551ms iteration = 33 status = {}
33092025-08-28T21:46:57.619ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33102025-08-28T21:46:57.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
33112025-08-28T21:46:57.628ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33122025-08-28T21:46:57.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
33132025-08-28T21:46:57.630ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33142025-08-28T21:46:57.634ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33152025-08-28T21:46:57.634ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33162025-08-28T21:46:57.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
33172025-08-28T21:46:57.639ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33182025-08-28T21:46:57.640ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33192025-08-28T21:46:57.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33202025-08-28T21:46:57.641ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33212025-08-28T21:46:57.641ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33222025-08-28T21:46:57.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
33232025-08-28T21:46:57.642ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 00cfe4f2-9fed-42f3-bd7c-dbdf1ed57d5e, rack_id: 8a92b2f1-f565-4a24-a10f-f55b1f446cc1, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(c2e57029-848b-4db2-bb2f-4a9b47d7bf41) } rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 switch_location = Switch0
33242025-08-28T21:46:57.642ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33252025-08-28T21:46:57.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33262025-08-28T21:46:57.652ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 207.378339ms iteration = 32 status = {"physical_disks_added":0}
33272025-08-28T21:46:57.655ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
33282025-08-28T21:46:57.655ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 210.370447ms iteration = 28 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
33292025-08-28T21:46:57.655ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
33302025-08-28T21:46:57.655ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = c2e57029-848b-4db2-bb2f-4a9b47d7bf41
33312025-08-28T21:46:57.656ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
33322025-08-28T21:46:57.656ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
33332025-08-28T21:46:57.656ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33342025-08-28T21:46:57.656ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33352025-08-28T21:46:57.656ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33362025-08-28T21:46:57.656ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
33372025-08-28T21:46:57.656ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33382025-08-28T21:46:57.656ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
33392025-08-28T21:46:57.656ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1
33402025-08-28T21:46:57.656ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33412025-08-28T21:46:57.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33422025-08-28T21:46:57.660ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 switch_location = Switch0
33432025-08-28T21:46:57.660ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
33442025-08-28T21:46:57.753ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
33452025-08-28T21:46:57.759ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8033e67-5199-43c9-951b-340225ef623a", "content-length": "691", "date": "Thu, 28 Aug 2025 21:46:57 GMT"} })
33462025-08-28T21:46:57.759ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
33472025-08-28T21:46:57.759ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
33482025-08-28T21:46:57.759ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
33492025-08-28T21:46:57.761ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 316.50472ms iteration = 31 status = {}
33502025-08-28T21:46:57.784ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ef676365-b24e-446b-bdd1-892bcf9375e1", "date": "Thu, 28 Aug 2025 21:46:57 GMT"} })
33512025-08-28T21:46:57.784ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 switch = Switch0
33522025-08-28T21:46:57.784ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
33532025-08-28T21:46:57.792ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "77d202f5-01b3-4c05-af3f-e2a1af6f5b04", "content-length": "682", "date": "Thu, 28 Aug 2025 21:46:57 GMT"} })
33542025-08-28T21:46:57.792ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33552025-08-28T21:46:57.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33562025-08-28T21:46:57.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33572025-08-28T21:46:57.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33582025-08-28T21:46:57.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33592025-08-28T21:46:57.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33602025-08-28T21:46:57.803ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33612025-08-28T21:46:57.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33622025-08-28T21:46:57.811ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 365.777457ms iteration = 28 status = {}
33632025-08-28T21:46:58.180ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = ac4bc62a-2994-430b-924b-bb3729a7f393 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
33642025-08-28T21:46:58.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = ac4bc62a-2994-430b-924b-bb3729a7f393 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
33652025-08-28T21:46:58.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2298 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = ac4bc62a-2994-430b-924b-bb3729a7f393 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
33662025-08-28T21:46:59.195ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = d4ce5ed6-db93-420e-9939-cfc939487df7 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
33672025-08-28T21:46:59.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = d4ce5ed6-db93-420e-9939-cfc939487df7 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
33682025-08-28T21:46:59.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 1944 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = d4ce5ed6-db93-420e-9939-cfc939487df7 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
33692025-08-28T21:46:59.893ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2586 local_addr = [fd00:1122:3344:101::a]:41821 method = GET remote_addr = [fd00:1122:3344:101::d]:45939 req_id = af39993a-b2b0-4ace-934c-a139d904b597 response_code = 200 uri = /0fe4e55a-5967-4507-9554-6c41366055df
33702025-08-28T21:47:00.211ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = f11a0ec1-e411-422e-84be-0a01cb386293 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
33712025-08-28T21:47:00.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = f11a0ec1-e411-422e-84be-0a01cb386293 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
33722025-08-28T21:47:00.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2419 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = f11a0ec1-e411-422e-84be-0a01cb386293 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
33732025-08-28T21:47:01.228ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = be58c849-12f0-4381-9771-2b8d87b94096 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
33742025-08-28T21:47:01.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = be58c849-12f0-4381-9771-2b8d87b94096 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
33752025-08-28T21:47:01.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2744 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = be58c849-12f0-4381-9771-2b8d87b94096 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
33762025-08-28T21:47:02.245ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 82269ed9-a716-4e71-909a-6f319e147726 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
33772025-08-28T21:47:02.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 82269ed9-a716-4e71-909a-6f319e147726 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
33782025-08-28T21:47:02.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2408 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 82269ed9-a716-4e71-909a-6f319e147726 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
33792025-08-28T21:47:02.445ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 164 reason = Timeout
33802025-08-28T21:47:02.445ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
33812025-08-28T21:47:02.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
33822025-08-28T21:47:02.448ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33832025-08-28T21:47:02.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
33842025-08-28T21:47:02.451ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
33852025-08-28T21:47:02.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
33862025-08-28T21:47:02.452ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
33872025-08-28T21:47:02.452ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.002311ms iteration = 164 status = {"chicken_switches_updated":false}
33882025-08-28T21:47:03.261ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 722771ed-12b0-4d3a-8b5a-042530e05606 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
33892025-08-28T21:47:03.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 722771ed-12b0-4d3a-8b5a-042530e05606 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
33902025-08-28T21:47:03.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2329 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 722771ed-12b0-4d3a-8b5a-042530e05606 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
33912025-08-28T21:47:04.277ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = a0d3c20d-c612-4807-821c-90244ae4e7e2 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
33922025-08-28T21:47:04.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = a0d3c20d-c612-4807-821c-90244ae4e7e2 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
33932025-08-28T21:47:04.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2792 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = a0d3c20d-c612-4807-821c-90244ae4e7e2 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
33942025-08-28T21:47:04.622ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::2]:50313
33952025-08-28T21:47:04.623ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50313 req_id = 11566501-ca50-4628-8224-5486b4ac41ef roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100 user_builtin_id = 001de000-05e4-4000-8000-000000000002
33962025-08-28T21:47:04.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50313 req_id = 11566501-ca50-4628-8224-5486b4ac41ef resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100 user_builtin_id = 001de000-05e4-4000-8000-000000000002
33972025-08-28T21:47:04.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 3461 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50313 req_id = 11566501-ca50-4628-8224-5486b4ac41ef response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
33982025-08-28T21:47:05.294ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 3cbf3555-1c86-4e57-961f-0c88d5135ec6 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
33992025-08-28T21:47:05.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 3cbf3555-1c86-4e57-961f-0c88d5135ec6 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
34002025-08-28T21:47:05.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 3207 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 3cbf3555-1c86-4e57-961f-0c88d5135ec6 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
34012025-08-28T21:47:06.311ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 50fe95d0-f46d-410b-b46f-2b5f691f8265 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
34022025-08-28T21:47:06.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 50fe95d0-f46d-410b-b46f-2b5f691f8265 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
34032025-08-28T21:47:06.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2057 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 50fe95d0-f46d-410b-b46f-2b5f691f8265 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
34042025-08-28T21:47:07.327ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = a66d788e-b5c6-4345-b286-ec39315955fa roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
34052025-08-28T21:47:07.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = a66d788e-b5c6-4345-b286-ec39315955fa resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
34062025-08-28T21:47:07.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2741 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = a66d788e-b5c6-4345-b286-ec39315955fa response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
34072025-08-28T21:47:07.445ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
34082025-08-28T21:47:07.445ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
34092025-08-28T21:47:07.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34102025-08-28T21:47:07.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34112025-08-28T21:47:07.445ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 165 reason = Timeout
34122025-08-28T21:47:07.445ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
34132025-08-28T21:47:07.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34142025-08-28T21:47:07.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
34152025-08-28T21:47:07.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
34162025-08-28T21:47:07.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34172025-08-28T21:47:07.448ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34182025-08-28T21:47:07.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34192025-08-28T21:47:07.448ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34202025-08-28T21:47:07.450ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.304412ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34212025-08-28T21:47:07.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34222025-08-28T21:47:07.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34232025-08-28T21:47:07.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
34242025-08-28T21:47:07.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
34252025-08-28T21:47:07.452ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
34262025-08-28T21:47:07.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
34272025-08-28T21:47:07.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34282025-08-28T21:47:07.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
34292025-08-28T21:47:07.454ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
34302025-08-28T21:47:07.454ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.411098ms iteration = 165 status = {"chicken_switches_updated":false}
34312025-08-28T21:47:07.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34322025-08-28T21:47:07.457ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 75210457-5921-4367-8327-1fd4d2d66bd6, lookup_type: ById(75210457-5921-4367-8327-1fd4d2d66bd6) } result = Ok(())
34332025-08-28T21:47:07.457ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34342025-08-28T21:47:07.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
34352025-08-28T21:47:07.472ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 original_time_created = 2025-08-28 21:33:17.370599 UTC target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 time_created = 2025-08-28 21:33:17.370599 UTC
34362025-08-28T21:47:07.472ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.144395ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"75210457-5921-4367-8327-1fd4d2d66bd6","time_created":"2025-08-28T21:33:17.370599Z"}
34372025-08-28T21:47:08.344ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 4acb11ff-b8f7-4679-a292-7a3a01699761 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
34382025-08-28T21:47:08.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 4acb11ff-b8f7-4679-a292-7a3a01699761 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
34392025-08-28T21:47:08.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2459 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 4acb11ff-b8f7-4679-a292-7a3a01699761 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
34402025-08-28T21:47:09.359ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 37231380-a308-4a39-b3bf-fde9053fdcfd roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
34412025-08-28T21:47:09.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 37231380-a308-4a39-b3bf-fde9053fdcfd resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
34422025-08-28T21:47:09.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2538 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 37231380-a308-4a39-b3bf-fde9053fdcfd response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
34432025-08-28T21:47:09.893ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 3004 local_addr = [fd00:1122:3344:101::a]:41821 method = GET remote_addr = [fd00:1122:3344:101::d]:45939 req_id = 62cbbce5-c546-479e-a763-92e967823cf7 response_code = 200 uri = /0fe4e55a-5967-4507-9554-6c41366055df
34442025-08-28T21:47:10.375ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 2ae83f2c-c2bb-4020-b4c3-2418e9bbec42 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
34452025-08-28T21:47:10.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 2ae83f2c-c2bb-4020-b4c3-2418e9bbec42 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
34462025-08-28T21:47:10.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2477 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 2ae83f2c-c2bb-4020-b4c3-2418e9bbec42 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
34472025-08-28T21:47:11.392ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 5de17cac-cd6d-4576-8245-b4090653c4ca roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
34482025-08-28T21:47:11.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 5de17cac-cd6d-4576-8245-b4090653c4ca resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
34492025-08-28T21:47:11.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2708 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 5de17cac-cd6d-4576-8245-b4090653c4ca response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
34502025-08-28T21:47:12.408ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 2293f541-c8b3-4f1c-b072-2c4d4cd819be roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
34512025-08-28T21:47:12.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 2293f541-c8b3-4f1c-b072-2c4d4cd819be resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
34522025-08-28T21:47:12.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 3087 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 2293f541-c8b3-4f1c-b072-2c4d4cd819be response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
34532025-08-28T21:47:12.446ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 166 reason = Timeout
34542025-08-28T21:47:12.446ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
34552025-08-28T21:47:12.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
34562025-08-28T21:47:12.449ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34572025-08-28T21:47:12.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
34582025-08-28T21:47:12.451ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
34592025-08-28T21:47:12.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
34602025-08-28T21:47:12.454ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
34612025-08-28T21:47:12.454ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.954396ms iteration = 166 status = {"chicken_switches_updated":false}
34622025-08-28T21:47:13.424ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 99cbbbb8-7e29-47d6-9951-0abf1a140756 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
34632025-08-28T21:47:13.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 99cbbbb8-7e29-47d6-9951-0abf1a140756 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
34642025-08-28T21:47:13.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2775 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 99cbbbb8-7e29-47d6-9951-0abf1a140756 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
34652025-08-28T21:47:14.440ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = a9e0e7d8-c558-48ac-9b9d-ac9afedbd84b roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
34662025-08-28T21:47:14.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = a9e0e7d8-c558-48ac-9b9d-ac9afedbd84b resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
34672025-08-28T21:47:14.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2241 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = a9e0e7d8-c558-48ac-9b9d-ac9afedbd84b response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
34682025-08-28T21:47:15.456ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 564fba98-19f0-47ac-8c18-335a0b75b5ae roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
34692025-08-28T21:47:15.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 564fba98-19f0-47ac-8c18-335a0b75b5ae resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
34702025-08-28T21:47:15.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2689 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 564fba98-19f0-47ac-8c18-335a0b75b5ae response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
34712025-08-28T21:47:16.473ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = b506c5c4-3b89-4cec-b44b-7a380f5cb917 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
34722025-08-28T21:47:16.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = b506c5c4-3b89-4cec-b44b-7a380f5cb917 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
34732025-08-28T21:47:16.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2089 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = b506c5c4-3b89-4cec-b44b-7a380f5cb917 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
34742025-08-28T21:47:17.445ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
34752025-08-28T21:47:17.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34762025-08-28T21:47:17.445ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
34772025-08-28T21:47:17.445ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 167 reason = Timeout
34782025-08-28T21:47:17.445ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
34792025-08-28T21:47:17.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34802025-08-28T21:47:17.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
34812025-08-28T21:47:17.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34822025-08-28T21:47:17.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
34832025-08-28T21:47:17.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34842025-08-28T21:47:17.447ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34852025-08-28T21:47:17.448ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34862025-08-28T21:47:17.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34872025-08-28T21:47:17.450ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.829615ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34882025-08-28T21:47:17.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34892025-08-28T21:47:17.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
34902025-08-28T21:47:17.451ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
34912025-08-28T21:47:17.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34922025-08-28T21:47:17.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
34932025-08-28T21:47:17.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
34942025-08-28T21:47:17.453ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
34952025-08-28T21:47:17.453ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.548066ms iteration = 167 status = {"chicken_switches_updated":false}
34962025-08-28T21:47:17.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34972025-08-28T21:47:17.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
34982025-08-28T21:47:17.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34992025-08-28T21:47:17.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 75210457-5921-4367-8327-1fd4d2d66bd6, lookup_type: ById(75210457-5921-4367-8327-1fd4d2d66bd6) } result = Ok(())
35002025-08-28T21:47:17.458ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35012025-08-28T21:47:17.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
35022025-08-28T21:47:17.472ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 original_time_created = 2025-08-28 21:33:17.370599 UTC target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 time_created = 2025-08-28 21:33:17.370599 UTC
35032025-08-28T21:47:17.472ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.858347ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"75210457-5921-4367-8327-1fd4d2d66bd6","time_created":"2025-08-28T21:33:17.370599Z"}
35042025-08-28T21:47:17.490ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = efd3fe48-a87b-4d0d-8ae5-6eda036c9213 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
35052025-08-28T21:47:17.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = efd3fe48-a87b-4d0d-8ae5-6eda036c9213 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
35062025-08-28T21:47:17.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2297 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = efd3fe48-a87b-4d0d-8ae5-6eda036c9213 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
35072025-08-28T21:47:18.506ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = d5faa404-614f-497f-bdd2-795180d35c6c roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
35082025-08-28T21:47:18.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = d5faa404-614f-497f-bdd2-795180d35c6c resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
35092025-08-28T21:47:18.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2352 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = d5faa404-614f-497f-bdd2-795180d35c6c response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
35102025-08-28T21:47:19.521ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = bcd6172a-73ff-4d56-9cc1-130ab48f130b roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
35112025-08-28T21:47:19.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = bcd6172a-73ff-4d56-9cc1-130ab48f130b resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
35122025-08-28T21:47:19.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2315 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = bcd6172a-73ff-4d56-9cc1-130ab48f130b response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
35132025-08-28T21:47:19.892ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2335 local_addr = [fd00:1122:3344:101::a]:41821 method = GET remote_addr = [fd00:1122:3344:101::d]:45939 req_id = aeb095ed-66cd-4f76-933e-9d0375b01eef response_code = 200 uri = /0fe4e55a-5967-4507-9554-6c41366055df
35142025-08-28T21:47:20.537ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 63b52aee-0076-4081-85b9-240ce5bfa7b5 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
35152025-08-28T21:47:20.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 63b52aee-0076-4081-85b9-240ce5bfa7b5 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
35162025-08-28T21:47:20.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2397 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 63b52aee-0076-4081-85b9-240ce5bfa7b5 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
35172025-08-28T21:47:21.553ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = d33283fb-9bdf-4005-804e-5b8cee3ddf15 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
35182025-08-28T21:47:21.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = d33283fb-9bdf-4005-804e-5b8cee3ddf15 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
35192025-08-28T21:47:21.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2691 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = d33283fb-9bdf-4005-804e-5b8cee3ddf15 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
35202025-08-28T21:47:22.445ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 168 reason = Timeout
35212025-08-28T21:47:22.445ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
35222025-08-28T21:47:22.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
35232025-08-28T21:47:22.448ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35242025-08-28T21:47:22.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
35252025-08-28T21:47:22.451ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
35262025-08-28T21:47:22.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
35272025-08-28T21:47:22.452ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
35282025-08-28T21:47:22.452ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.418162ms iteration = 168 status = {"chicken_switches_updated":false}
35292025-08-28T21:47:22.569ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 42c16e0b-6ec0-4a84-900b-d71fd69ddcb9 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
35302025-08-28T21:47:22.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 42c16e0b-6ec0-4a84-900b-d71fd69ddcb9 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
35312025-08-28T21:47:22.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2007 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 42c16e0b-6ec0-4a84-900b-d71fd69ddcb9 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
35322025-08-28T21:47:23.584ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = e8ec7fec-6547-4dcb-a431-4467cfed15ca roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
35332025-08-28T21:47:23.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = e8ec7fec-6547-4dcb-a431-4467cfed15ca resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
35342025-08-28T21:47:23.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2475 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = e8ec7fec-6547-4dcb-a431-4467cfed15ca response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
35352025-08-28T21:47:24.601ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 7dec01d0-9462-4edb-8535-9b22bd41f8ac roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
35362025-08-28T21:47:24.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 7dec01d0-9462-4edb-8535-9b22bd41f8ac resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
35372025-08-28T21:47:24.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2364 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 7dec01d0-9462-4edb-8535-9b22bd41f8ac response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
35382025-08-28T21:47:24.748ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::d]:53866
35392025-08-28T21:47:24.748ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53866 req_id = f269e32a-49a1-4295-b5fe-60641258ff67 roles = RoleSet { roles: {} } uri = /metrics/collectors/fbcc3716-f2fd-4c7d-a691-c299da81c53f/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
35402025-08-28T21:47:24.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53866 req_id = f269e32a-49a1-4295-b5fe-60641258ff67 resource = Database result = Ok(()) uri = /metrics/collectors/fbcc3716-f2fd-4c7d-a691-c299da81c53f/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
35412025-08-28T21:47:24.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2639 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53866 req_id = f269e32a-49a1-4295-b5fe-60641258ff67 response_code = 200 uri = /metrics/collectors/fbcc3716-f2fd-4c7d-a691-c299da81c53f/producers?sort_by=id_ascending
35422025-08-28T21:47:24.751ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53866 req_id = a9c23410-fe69-4b60-ab3d-2df58ac19299 roles = RoleSet { roles: {} } uri = /metrics/collectors/fbcc3716-f2fd-4c7d-a691-c299da81c53f/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE1M2ViMS1jM2Y2LTRhYjctYmU4Yi1hZWNmZDVmZWY0NTAifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
35432025-08-28T21:47:24.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53866 req_id = a9c23410-fe69-4b60-ab3d-2df58ac19299 resource = Database result = Ok(()) uri = /metrics/collectors/fbcc3716-f2fd-4c7d-a691-c299da81c53f/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE1M2ViMS1jM2Y2LTRhYjctYmU4Yi1hZWNmZDVmZWY0NTAifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
35442025-08-28T21:47:24.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2417 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53866 req_id = a9c23410-fe69-4b60-ab3d-2df58ac19299 response_code = 200 uri = /metrics/collectors/fbcc3716-f2fd-4c7d-a691-c299da81c53f/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE1M2ViMS1jM2Y2LTRhYjctYmU4Yi1hZWNmZDVmZWY0NTAifX0%3D
35452025-08-28T21:47:25.617ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 14769012-b600-4338-97d0-4e8fc85ebc60 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
35462025-08-28T21:47:25.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 14769012-b600-4338-97d0-4e8fc85ebc60 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
35472025-08-28T21:47:25.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2751 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 14769012-b600-4338-97d0-4e8fc85ebc60 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
35482025-08-28T21:47:26.635ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = dc125b41-4799-441d-a555-d97c20b772a7 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
35492025-08-28T21:47:26.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = dc125b41-4799-441d-a555-d97c20b772a7 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
35502025-08-28T21:47:26.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2614 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = dc125b41-4799-441d-a555-d97c20b772a7 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
35512025-08-28T21:47:27.313ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
35522025-08-28T21:47:27.313ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
35532025-08-28T21:47:27.313ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
35542025-08-28T21:47:27.313ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:91 reason = blueprint disabled target_id = 75210457-5921-4367-8327-1fd4d2d66bd6
35552025-08-28T21:47:27.313ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35562025-08-28T21:47:27.313ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 27.981\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"75210457-5921-4367-8327-1fd4d2d66bd6"}
35572025-08-28T21:47:27.313ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
35582025-08-28T21:47:27.313ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
35592025-08-28T21:47:27.313ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-28 21:37:27.313840726 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
35602025-08-28T21:47:27.313ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
35612025-08-28T21:47:27.313ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
35622025-08-28T21:47:27.313ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
35632025-08-28T21:47:27.313ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35642025-08-28T21:47:27.313ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
35652025-08-28T21:47:27.314ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
35662025-08-28T21:47:27.314ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35672025-08-28T21:47:27.314ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
35682025-08-28T21:47:27.314ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
35692025-08-28T21:47:27.314ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
35702025-08-28T21:47:27.314ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
35712025-08-28T21:47:27.314ZDEBGnexus (BackgroundTasks): activating background_task = nat_garbage_collector iteration = 29 reason = Timeout
35722025-08-28T21:47:27.314ZDEBGnexus (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
35732025-08-28T21:47:27.314ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
35742025-08-28T21:47:27.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
35752025-08-28T21:47:27.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35762025-08-28T21:47:27.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = bfd_manager resource = Database result = Ok(())
35772025-08-28T21:47:27.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35782025-08-28T21:47:27.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
35792025-08-28T21:47:27.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
35802025-08-28T21:47:27.314ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("29f5e375-8d13-490a-8d8c-25abbffb62fc.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f7509ee4-501a-451c-a026-2b7946c79d73.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f7509ee4-501a-451c-a026-2b7946c79d73.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1815, tv_nsec: 846870732 } })
35812025-08-28T21:47:27.314ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("34926ba2-743e-40ae-813d-5f114d8a9912.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3683ed2f-b132-4612-ad98-adc9a748bc7e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e7031451-4fb4-459c-889a-f39ec3c49e88.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("e7031451-4fb4-459c-889a-f39ec3c49e88.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 1815, tv_nsec: 846896803 } })
35822025-08-28T21:47:27.315ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35832025-08-28T21:47:27.315ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
35842025-08-28T21:47:27.315ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.082688ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
35852025-08-28T21:47:27.315ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35862025-08-28T21:47:27.315ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
35872025-08-28T21:47:27.315ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.098498ms iteration = 16 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
35882025-08-28T21:47:27.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35892025-08-28T21:47:27.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35902025-08-28T21:47:27.316ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35912025-08-28T21:47:27.316ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-28 21:37:27.313840726 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
35922025-08-28T21:47:27.316ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.960006ms iteration = 15 status = {"expiration":"2025-08-28T21:37:27.313840726Z","pruned":[]}
35932025-08-28T21:47:27.316ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1815, tv_nsec: 849189433 } })
35942025-08-28T21:47:27.316ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1815, tv_nsec: 849188823 } })
35952025-08-28T21:47:27.317ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35962025-08-28T21:47:27.317ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1205
35972025-08-28T21:47:27.317ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_garbage_collector file = nexus/src/app/mod.rs:1205
35982025-08-28T21:47:27.317ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35992025-08-28T21:47:27.317ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.662535ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
36002025-08-28T21:47:27.319ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
36012025-08-28T21:47:27.319ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36022025-08-28T21:47:27.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
36032025-08-28T21:47:27.320ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36042025-08-28T21:47:27.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
36052025-08-28T21:47:27.321ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36062025-08-28T21:47:27.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
36072025-08-28T21:47:27.322ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
36082025-08-28T21:47:27.322ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
36092025-08-28T21:47:27.322ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
36102025-08-28T21:47:27.322ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36112025-08-28T21:47:27.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36122025-08-28T21:47:27.323ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36132025-08-28T21:47:27.324ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36142025-08-28T21:47:27.326ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
36152025-08-28T21:47:27.326ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36162025-08-28T21:47:27.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
36172025-08-28T21:47:27.327ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
36182025-08-28T21:47:27.327ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36192025-08-28T21:47:27.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36202025-08-28T21:47:27.328ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36212025-08-28T21:47:27.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
36222025-08-28T21:47:27.328ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 20 reason = Timeout
36232025-08-28T21:47:27.328ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
36242025-08-28T21:47:27.328ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
36252025-08-28T21:47:27.328ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 10.44\u{b5}s iteration = 20 status = "Disabled"
36262025-08-28T21:47:27.328ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
36272025-08-28T21:47:27.329ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
36282025-08-28T21:47:27.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
36292025-08-28T21:47:27.329ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36302025-08-28T21:47:27.330ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36312025-08-28T21:47:27.332ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
36322025-08-28T21:47:27.332ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36332025-08-28T21:47:27.332ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
36342025-08-28T21:47:27.332ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
36352025-08-28T21:47:27.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
36362025-08-28T21:47:27.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
36372025-08-28T21:47:27.335ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
36382025-08-28T21:47:27.335ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
36392025-08-28T21:47:27.335ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 6.836938ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
36402025-08-28T21:47:27.338ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-28T21:33:21.286055Z, time_modified: 2025-08-28T21:33:21.286055Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, db_silo: Silo { identity: SiloIdentity { id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-28T21:34:05.369976Z, time_modified: 2025-08-28T21:34:05.369976Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b6acf240eb452c21e0b1e580a1d52c2797fabc391b3eb746647244649b18e959" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, db_silo: Silo { identity: SiloIdentity { id: 427aaf87-3d8a-4dc0-888f-bfc71eaeae3f, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-28T21:34:05.369976Z, time_modified: 2025-08-28T21:34:05.369976Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b6acf240eb452c21e0b1e580a1d52c2797fabc391b3eb746647244649b18e959" }] }) }
36412025-08-28T21:47:27.339ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 25.065411ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"427aaf87-3d8a-4dc0-888f-bfc71eaeae3f","tls_certs":["b6acf240eb452c21e0b1e580a1d52c2797fabc391b3eb746647244649b18e959"]}},"default_endpoint":{"silo_id":"427aaf87-3d8a-4dc0-888f-bfc71eaeae3f","tls_certs":["b6acf240eb452c21e0b1e580a1d52c2797fabc391b3eb746647244649b18e959"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
36422025-08-28T21:47:27.340ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
36432025-08-28T21:47:27.340ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
36442025-08-28T21:47:27.340ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
36452025-08-28T21:47:27.340ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
36462025-08-28T21:47:27.340ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
36472025-08-28T21:47:27.340ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
36482025-08-28T21:47:27.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
36492025-08-28T21:47:27.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database result = Ok(())
36502025-08-28T21:47:27.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = lookup_region_port resource = Database result = Ok(())
36512025-08-28T21:47:27.343ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 2.964617ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
36522025-08-28T21:47:27.344ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
36532025-08-28T21:47:27.344ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
36542025-08-28T21:47:27.344ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 3.879961ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
36552025-08-28T21:47:27.347ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 15 reason = Timeout
36562025-08-28T21:47:27.347ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 15 reason = Timeout
36572025-08-28T21:47:27.347ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
36582025-08-28T21:47:27.347ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
36592025-08-28T21:47:27.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database result = Ok(())
36602025-08-28T21:47:27.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = webhook_deliverator resource = Database result = Ok(())
36612025-08-28T21:47:27.349ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
36622025-08-28T21:47:27.349ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 2.229678ms iteration = 15 status = {"by_rx":{},"error":null}
36632025-08-28T21:47:27.350ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
36642025-08-28T21:47:27.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database result = Ok(())
36652025-08-28T21:47:27.353ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 6.375076ms iteration = 15 status = {"dispatched":[],"errors":[],"glob_version":"183.0.0","globs_reprocessed":{},"no_receivers":[]}
36662025-08-28T21:47:27.356ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
36672025-08-28T21:47:27.356ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
36682025-08-28T21:47:27.356ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
36692025-08-28T21:47:27.356ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36702025-08-28T21:47:27.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36712025-08-28T21:47:27.357ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36722025-08-28T21:47:27.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36732025-08-28T21:47:27.362ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36742025-08-28T21:47:27.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36752025-08-28T21:47:27.363ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
36762025-08-28T21:47:27.363ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = be33e1d0-e98d-462e-bd25-7cffb75dab02 dns_zone_name = oxide.test found_so_far = 0 version = 2
36772025-08-28T21:47:27.363ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36782025-08-28T21:47:27.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36792025-08-28T21:47:27.364ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
36802025-08-28T21:47:27.364ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 00f179d2-0574-4e49-85ff-8736d21b9fd1 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
36812025-08-28T21:47:27.364ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36822025-08-28T21:47:27.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36832025-08-28T21:47:27.365ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36842025-08-28T21:47:27.365ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36852025-08-28T21:47:27.369ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
36862025-08-28T21:47:27.369ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36872025-08-28T21:47:27.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36882025-08-28T21:47:27.369ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36892025-08-28T21:47:27.369ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36902025-08-28T21:47:27.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36912025-08-28T21:47:27.370ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = be33e1d0-e98d-462e-bd25-7cffb75dab02 dns_zone_name = oxide.test found_so_far = 4 version = 2
36922025-08-28T21:47:27.370ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
36932025-08-28T21:47:27.370ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-28 21:34:05.486436 UTC dns_group = external generation = 2
36942025-08-28T21:47:27.370ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 57.090571ms iteration = 16 status = {"generation":2}
36952025-08-28T21:47:27.371ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 00f179d2-0574-4e49-85ff-8736d21b9fd1 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
36962025-08-28T21:47:27.371ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
36972025-08-28T21:47:27.371ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-28 21:34:04.777048 UTC dns_group = internal generation = 1
36982025-08-28T21:47:27.371ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 57.685976ms iteration = 16 status = {"generation":1}
36992025-08-28T21:47:27.418ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
37002025-08-28T21:47:27.420ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
37012025-08-28T21:47:27.425ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_garbage_collector file = nexus/src/app/mod.rs:1213 zone_address = fd00:1122:3344:101::2
37022025-08-28T21:47:27.425ZDEBGnexus (MgsClient): client request background_task = nat_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37032025-08-28T21:47:27.425ZDEBGnexus (MgsClient): client response background_task = nat_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f6fc41d-e683-4776-84fd-9f505f56a257", "content-length": "26", "date": "Thu, 28 Aug 2025 21:47:26 GMT"} })
37042025-08-28T21:47:27.425ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_garbage_collector file = nexus/src/app/mod.rs:1216 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37052025-08-28T21:47:27.426ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1213 zone_address = fd00:1122:3344:101::2
37062025-08-28T21:47:27.426ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37072025-08-28T21:47:27.426ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "056fd356-a6e1-4c0d-aa0e-a87e393d8312", "content-length": "26", "date": "Thu, 28 Aug 2025 21:47:26 GMT"} })
37082025-08-28T21:47:27.426ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1216 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37092025-08-28T21:47:27.427ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_garbage_collector file = nexus/src/app/mod.rs:1250 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37102025-08-28T21:47:27.427ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1250 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37112025-08-28T21:47:27.443ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
37122025-08-28T21:47:27.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database result = Ok(())
37132025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 29 reason = Timeout
37142025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
37152025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 13.531\u{b5}s iteration = 29 status = {"disabled":true,"errors":[],"sps":[]}
37162025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 34 reason = Timeout
37172025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37182025-08-28T21:47:27.445ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
37192025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37202025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
37212025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37222025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
37232025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
37242025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
37252025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37262025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
37272025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37282025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 169 reason = Timeout
37292025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
37302025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
37312025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
37322025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
37332025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37342025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37352025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
37362025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37372025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
37382025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37392025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 29 reason = Timeout
37402025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
37412025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
37422025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37432025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
37442025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
37452025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37462025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 29 reason = Timeout
37472025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
37482025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
37492025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37502025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 32 reason = Timeout
37512025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37522025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37532025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
37542025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
37552025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37562025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
37572025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37582025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
37592025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
37602025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
37612025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37622025-08-28T21:47:27.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
37632025-08-28T21:47:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37642025-08-28T21:47:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37652025-08-28T21:47:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
37662025-08-28T21:47:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
37672025-08-28T21:47:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
37682025-08-28T21:47:27.447ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37692025-08-28T21:47:27.447ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37702025-08-28T21:47:27.447ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37712025-08-28T21:47:27.447ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.623778ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
37722025-08-28T21:47:27.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37732025-08-28T21:47:27.448ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37742025-08-28T21:47:27.448ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.842904ms iteration = 29 status = {"errors":[],"finish_invoked_ok":[]}
37752025-08-28T21:47:27.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37762025-08-28T21:47:27.448ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37772025-08-28T21:47:27.448ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37782025-08-28T21:47:27.448ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37792025-08-28T21:47:27.449ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37802025-08-28T21:47:27.449ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
37812025-08-28T21:47:27.449ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37822025-08-28T21:47:27.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
37832025-08-28T21:47:27.449ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.344032ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37842025-08-28T21:47:27.451ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37852025-08-28T21:47:27.451ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37862025-08-28T21:47:27.451ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
37872025-08-28T21:47:27.451ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37882025-08-28T21:47:27.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37892025-08-28T21:47:27.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
37902025-08-28T21:47:27.452ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37912025-08-28T21:47:27.452ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37922025-08-28T21:47:27.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37932025-08-28T21:47:27.454ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.777877ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
37942025-08-28T21:47:27.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
37952025-08-28T21:47:27.454ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37962025-08-28T21:47:27.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37972025-08-28T21:47:27.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37982025-08-28T21:47:27.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
37992025-08-28T21:47:27.454ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
38002025-08-28T21:47:27.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38012025-08-28T21:47:27.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
38022025-08-28T21:47:27.454ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38032025-08-28T21:47:27.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Fleet result = Ok(())
38042025-08-28T21:47:27.454ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38052025-08-28T21:47:27.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
38062025-08-28T21:47:27.454ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38072025-08-28T21:47:27.454ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
38082025-08-28T21:47:27.454ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 9.6284ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
38092025-08-28T21:47:27.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
38102025-08-28T21:47:27.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
38112025-08-28T21:47:27.455ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38122025-08-28T21:47:27.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
38132025-08-28T21:47:27.455ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
38142025-08-28T21:47:27.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38152025-08-28T21:47:27.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
38162025-08-28T21:47:27.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38172025-08-28T21:47:27.456ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-af8277ed-838c-4274-8629-14eae35fd0e4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1815, tv_nsec: 989110912 } })
38182025-08-28T21:47:27.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
38192025-08-28T21:47:27.457ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1205 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1
38202025-08-28T21:47:27.457ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
38212025-08-28T21:47:27.457ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38222025-08-28T21:47:27.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38232025-08-28T21:47:27.457ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
38242025-08-28T21:47:27.458ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 12.71706ms iteration = 169 status = {"chicken_switches_updated":false}
38252025-08-28T21:47:27.458ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38262025-08-28T21:47:27.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38272025-08-28T21:47:27.458ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38282025-08-28T21:47:27.463ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 75210457-5921-4367-8327-1fd4d2d66bd6, lookup_type: ById(75210457-5921-4367-8327-1fd4d2d66bd6) } result = Ok(())
38292025-08-28T21:47:27.463ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38302025-08-28T21:47:27.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
38312025-08-28T21:47:27.472ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
38322025-08-28T21:47:27.472ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 27.142854ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
38332025-08-28T21:47:27.499ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 original_time_created = 2025-08-28 21:33:17.370599 UTC target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 time_created = 2025-08-28 21:33:17.370599 UTC
38342025-08-28T21:47:27.499ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.263218ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"75210457-5921-4367-8327-1fd4d2d66bd6","time_created":"2025-08-28T21:33:17.370599Z"}
38352025-08-28T21:47:27.502ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
38362025-08-28T21:47:27.502ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 161.621963ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
38372025-08-28T21:47:27.519ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38382025-08-28T21:47:27.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
38392025-08-28T21:47:27.520ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38402025-08-28T21:47:27.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38412025-08-28T21:47:27.522ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 76.905825ms iteration = 29 status = {"errors":[],"requests_created_ok":[]}
38422025-08-28T21:47:27.523ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 77.938751ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
38432025-08-28T21:47:27.525ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38442025-08-28T21:47:27.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38452025-08-28T21:47:27.530ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 84.758619ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
38462025-08-28T21:47:27.535ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38472025-08-28T21:47:27.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38482025-08-28T21:47:27.543ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38492025-08-28T21:47:27.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38502025-08-28T21:47:27.551ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
38512025-08-28T21:47:27.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
38522025-08-28T21:47:27.555ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38532025-08-28T21:47:27.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
38542025-08-28T21:47:27.558ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
38552025-08-28T21:47:27.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
38562025-08-28T21:47:27.561ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38572025-08-28T21:47:27.561ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
38582025-08-28T21:47:27.561ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 116.024949ms iteration = 29 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
38592025-08-28T21:47:27.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38602025-08-28T21:47:27.566ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38612025-08-28T21:47:27.567ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38622025-08-28T21:47:27.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
38632025-08-28T21:47:27.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38642025-08-28T21:47:27.570ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38652025-08-28T21:47:27.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38662025-08-28T21:47:27.578ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38672025-08-28T21:47:27.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38682025-08-28T21:47:27.581ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38692025-08-28T21:47:27.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
38702025-08-28T21:47:27.582ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38712025-08-28T21:47:27.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38722025-08-28T21:47:27.583ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 137.748833ms iteration = 33 status = {"physical_disks_added":0}
38732025-08-28T21:47:27.584ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38742025-08-28T21:47:27.585ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38752025-08-28T21:47:27.589ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38762025-08-28T21:47:27.589ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38772025-08-28T21:47:27.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
38782025-08-28T21:47:27.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: af8277ed-838c-4274-8629-14eae35fd0e4, lookup_type: ById(af8277ed-838c-4274-8629-14eae35fd0e4) } result = Ok(())
38792025-08-28T21:47:27.591ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38802025-08-28T21:47:27.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38812025-08-28T21:47:27.593ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38822025-08-28T21:47:27.593ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 148.769988ms iteration = 29 status = 0
38832025-08-28T21:47:27.596ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38842025-08-28T21:47:27.596ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38852025-08-28T21:47:27.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
38862025-08-28T21:47:27.600ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 285.28108ms iteration = 29 status = {}
38872025-08-28T21:47:27.601ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
38882025-08-28T21:47:27.630ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
38892025-08-28T21:47:27.630ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "1196b4a4-c1c3-4f78-af42-e1c9666ad20a", "date": "Thu, 28 Aug 2025 21:47:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
38902025-08-28T21:47:27.630ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
38912025-08-28T21:47:27.632ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f1bf4f0c-c1bb-4d06-a717-6392e8d4087f", "date": "Thu, 28 Aug 2025 21:47:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
38922025-08-28T21:47:27.632ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
38932025-08-28T21:47:27.635ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
38942025-08-28T21:47:27.635ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 321.622882ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
38952025-08-28T21:47:27.650ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 1efae32a-f887-46cc-ba97-9da24a10727f roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
38962025-08-28T21:47:27.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 1efae32a-f887-46cc-ba97-9da24a10727f resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
38972025-08-28T21:47:27.651ZDEBGnexus (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
38982025-08-28T21:47:27.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
38992025-08-28T21:47:27.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2676 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 1efae32a-f887-46cc-ba97-9da24a10727f response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
39002025-08-28T21:47:27.654ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_garbage_collector elapsed = 340.155593ms iteration = 29 status = null
39012025-08-28T21:47:27.714ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1213 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 zone_address = fd00:1122:3344:101::2
39022025-08-28T21:47:27.714ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39032025-08-28T21:47:27.715ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9bafeece-1abf-409c-8dbe-9c990809bd1f", "content-length": "26", "date": "Thu, 28 Aug 2025 21:47:27 GMT"} })
39042025-08-28T21:47:27.715ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1216 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39052025-08-28T21:47:27.717ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1250 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1
39062025-08-28T21:47:27.734ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
39072025-08-28T21:47:27.735ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "27b785ad-9200-4ae7-ae26-94a60f58a71e", "content-length": "691", "date": "Thu, 28 Aug 2025 21:47:27 GMT"} })
39082025-08-28T21:47:27.735ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
39092025-08-28T21:47:27.735ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
39102025-08-28T21:47:27.735ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
39112025-08-28T21:47:27.736ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 291.031369ms iteration = 32 status = {}
39122025-08-28T21:47:27.752ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
39132025-08-28T21:47:27.752ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "3a3a2e53-16df-4b20-a524-2ca3bb611159", "date": "Thu, 28 Aug 2025 21:47:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
39142025-08-28T21:47:27.752ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
39152025-08-28T21:47:27.754ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f1f90aa8-afab-40f7-9fcb-3774c194d643", "date": "Thu, 28 Aug 2025 21:47:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
39162025-08-28T21:47:27.754ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
39172025-08-28T21:47:27.756ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e93477a7-6b34-41c5-a066-c1dc32067504", "date": "Thu, 28 Aug 2025 21:47:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
39182025-08-28T21:47:27.756ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
39192025-08-28T21:47:27.758ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
39202025-08-28T21:47:27.758ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 444.862039ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
39212025-08-28T21:47:27.779ZINFOnexus (BackgroundTasks): VPC route manager sled af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
39222025-08-28T21:47:27.779ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
39232025-08-28T21:47:27.779ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ccedca39-6d3a-4651-9ac4-20440782388f", "content-length": "372", "date": "Thu, 28 Aug 2025 21:47:27 GMT"} })
39242025-08-28T21:47:27.779ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39252025-08-28T21:47:27.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39262025-08-28T21:47:27.797ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
39272025-08-28T21:47:27.797ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
39282025-08-28T21:47:27.798ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2c83c1a6-72c6-410f-bdbf-455717f54a81", "date": "Thu, 28 Aug 2025 21:47:27 GMT"} })
39292025-08-28T21:47:27.798ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39302025-08-28T21:47:27.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39312025-08-28T21:47:27.800ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39322025-08-28T21:47:27.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39332025-08-28T21:47:27.804ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39342025-08-28T21:47:27.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39352025-08-28T21:47:27.806ZINFOnexus (BackgroundTasks): VPC route manager sled af8277ed-838c-4274-8629-14eae35fd0e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
39362025-08-28T21:47:27.806ZDEBGnexus (BackgroundTasks): client request SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
39372025-08-28T21:47:27.807ZDEBGnexus (BackgroundTasks): client response SledAgent = af8277ed-838c-4274-8629-14eae35fd0e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1b90d975-271d-4e70-9db2-9ff36193c32d", "date": "Thu, 28 Aug 2025 21:47:27 GMT"} })
39382025-08-28T21:47:27.809ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 363.859688ms iteration = 34 status = {}
39392025-08-28T21:47:27.865ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39402025-08-28T21:47:27.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39412025-08-28T21:47:27.866ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 00cfe4f2-9fed-42f3-bd7c-dbdf1ed57d5e, rack_id: 8a92b2f1-f565-4a24-a10f-f55b1f446cc1, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(c2e57029-848b-4db2-bb2f-4a9b47d7bf41) } rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 switch_location = Switch0
39422025-08-28T21:47:27.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39432025-08-28T21:47:27.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39442025-08-28T21:47:27.879ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
39452025-08-28T21:47:27.879ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = c2e57029-848b-4db2-bb2f-4a9b47d7bf41
39462025-08-28T21:47:27.879ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
39472025-08-28T21:47:27.879ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
39482025-08-28T21:47:27.879ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39492025-08-28T21:47:27.879ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39502025-08-28T21:47:27.879ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39512025-08-28T21:47:27.879ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
39522025-08-28T21:47:27.879ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39532025-08-28T21:47:27.879ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
39542025-08-28T21:47:27.879ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1
39552025-08-28T21:47:27.879ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39562025-08-28T21:47:27.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39572025-08-28T21:47:27.882ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 switch_location = Switch0
39582025-08-28T21:47:27.882ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
39592025-08-28T21:47:27.995ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "566ac97e-7222-44d2-b77e-a732123a15c0", "date": "Thu, 28 Aug 2025 21:47:27 GMT"} })
39602025-08-28T21:47:27.995ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 switch = Switch0
39612025-08-28T21:47:27.995ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
39622025-08-28T21:47:28.002ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8a92b2f1-f565-4a24-a10f-f55b1f446cc1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8774603c-7169-4384-b258-909b352d6252", "content-length": "682", "date": "Thu, 28 Aug 2025 21:47:27 GMT"} })
39632025-08-28T21:47:28.002ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39642025-08-28T21:47:28.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39652025-08-28T21:47:28.006ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39662025-08-28T21:47:28.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39672025-08-28T21:47:28.010ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39682025-08-28T21:47:28.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39692025-08-28T21:47:28.012ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39702025-08-28T21:47:28.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39712025-08-28T21:47:28.019ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 574.182142ms iteration = 29 status = {}
39722025-08-28T21:47:28.671ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 596657b3-4231-4fb9-bbd6-62f604ab22e4 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
39732025-08-28T21:47:28.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 596657b3-4231-4fb9-bbd6-62f604ab22e4 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
39742025-08-28T21:47:28.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2485 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 596657b3-4231-4fb9-bbd6-62f604ab22e4 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
39752025-08-28T21:47:29.686ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = eee9257d-928a-43a8-9fd3-33caa6fd409a roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
39762025-08-28T21:47:29.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = eee9257d-928a-43a8-9fd3-33caa6fd409a resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
39772025-08-28T21:47:29.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2552 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = eee9257d-928a-43a8-9fd3-33caa6fd409a response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
39782025-08-28T21:47:29.892ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2588 local_addr = [fd00:1122:3344:101::a]:41821 method = GET remote_addr = [fd00:1122:3344:101::d]:45939 req_id = 936a4d37-be25-4eb9-8937-3415a949db47 response_code = 200 uri = /0fe4e55a-5967-4507-9554-6c41366055df
39792025-08-28T21:47:30.702ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 5717038b-c08e-41bb-8057-60bfe5f26113 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
39802025-08-28T21:47:30.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 5717038b-c08e-41bb-8057-60bfe5f26113 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
39812025-08-28T21:47:30.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2418 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 5717038b-c08e-41bb-8057-60bfe5f26113 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
39822025-08-28T21:47:31.720ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 1c893dbe-c215-4539-bb4e-4ec8b5d81acb roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
39832025-08-28T21:47:31.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 1c893dbe-c215-4539-bb4e-4ec8b5d81acb resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
39842025-08-28T21:47:31.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2434 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 1c893dbe-c215-4539-bb4e-4ec8b5d81acb response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
39852025-08-28T21:47:32.445ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 170 reason = Timeout
39862025-08-28T21:47:32.445ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
39872025-08-28T21:47:32.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
39882025-08-28T21:47:32.448ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39892025-08-28T21:47:32.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
39902025-08-28T21:47:32.450ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
39912025-08-28T21:47:32.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
39922025-08-28T21:47:32.452ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
39932025-08-28T21:47:32.452ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.049623ms iteration = 170 status = {"chicken_switches_updated":false}
39942025-08-28T21:47:32.736ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 44e26d90-85e0-4d0e-98d8-2cf41ffdddbd roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
39952025-08-28T21:47:32.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 44e26d90-85e0-4d0e-98d8-2cf41ffdddbd resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
39962025-08-28T21:47:32.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2382 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 44e26d90-85e0-4d0e-98d8-2cf41ffdddbd response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
39972025-08-28T21:47:33.752ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = b8ae48b1-b33e-435d-8148-58dd22506c43 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
39982025-08-28T21:47:33.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = b8ae48b1-b33e-435d-8148-58dd22506c43 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
39992025-08-28T21:47:33.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2197 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = b8ae48b1-b33e-435d-8148-58dd22506c43 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
40002025-08-28T21:47:34.659ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::2]:61977
40012025-08-28T21:47:34.659ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61977 req_id = b58ff55c-dd3f-4ec8-8c74-7dfcd869b8ed roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100 user_builtin_id = 001de000-05e4-4000-8000-000000000002
40022025-08-28T21:47:34.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61977 req_id = b58ff55c-dd3f-4ec8-8c74-7dfcd869b8ed resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100 user_builtin_id = 001de000-05e4-4000-8000-000000000002
40032025-08-28T21:47:34.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 3080 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61977 req_id = b58ff55c-dd3f-4ec8-8c74-7dfcd869b8ed response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
40042025-08-28T21:47:34.769ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = b28bcb99-f7ae-4a5b-a846-1e9705015c37 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
40052025-08-28T21:47:34.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = b28bcb99-f7ae-4a5b-a846-1e9705015c37 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
40062025-08-28T21:47:34.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2340 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = b28bcb99-f7ae-4a5b-a846-1e9705015c37 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
40072025-08-28T21:47:35.785ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 330c118c-078d-4a1c-8aa1-ac26945a1879 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
40082025-08-28T21:47:35.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 330c118c-078d-4a1c-8aa1-ac26945a1879 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
40092025-08-28T21:47:35.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2958 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 330c118c-078d-4a1c-8aa1-ac26945a1879 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
40102025-08-28T21:47:36.804ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = dc438184-ceaa-4a78-8cde-cb93fad0da71 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
40112025-08-28T21:47:36.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = dc438184-ceaa-4a78-8cde-cb93fad0da71 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
40122025-08-28T21:47:36.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2609 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = dc438184-ceaa-4a78-8cde-cb93fad0da71 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
40132025-08-28T21:47:37.445ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
40142025-08-28T21:47:37.445ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
40152025-08-28T21:47:37.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40162025-08-28T21:47:37.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40172025-08-28T21:47:37.445ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 171 reason = Timeout
40182025-08-28T21:47:37.445ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
40192025-08-28T21:47:37.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
40202025-08-28T21:47:37.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40212025-08-28T21:47:37.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
40222025-08-28T21:47:37.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40232025-08-28T21:47:37.447ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40242025-08-28T21:47:37.447ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40252025-08-28T21:47:37.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40262025-08-28T21:47:37.449ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.520667ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40272025-08-28T21:47:37.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40282025-08-28T21:47:37.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40292025-08-28T21:47:37.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
40302025-08-28T21:47:37.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
40312025-08-28T21:47:37.451ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
40322025-08-28T21:47:37.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
40332025-08-28T21:47:37.453ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
40342025-08-28T21:47:37.453ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.947076ms iteration = 171 status = {"chicken_switches_updated":false}
40352025-08-28T21:47:37.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40362025-08-28T21:47:37.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
40372025-08-28T21:47:37.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40382025-08-28T21:47:37.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 75210457-5921-4367-8327-1fd4d2d66bd6, lookup_type: ById(75210457-5921-4367-8327-1fd4d2d66bd6) } result = Ok(())
40392025-08-28T21:47:37.458ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40402025-08-28T21:47:37.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
40412025-08-28T21:47:37.476ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 original_time_created = 2025-08-28 21:33:17.370599 UTC target_id = 75210457-5921-4367-8327-1fd4d2d66bd6 time_created = 2025-08-28 21:33:17.370599 UTC
40422025-08-28T21:47:37.476ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 31.316782ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"75210457-5921-4367-8327-1fd4d2d66bd6","time_created":"2025-08-28T21:33:17.370599Z"}
40432025-08-28T21:47:37.820ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 1a37cde6-5a12-4ed6-88c7-ececddb61cd5 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
40442025-08-28T21:47:37.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 1a37cde6-5a12-4ed6-88c7-ececddb61cd5 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
40452025-08-28T21:47:37.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2031 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 1a37cde6-5a12-4ed6-88c7-ececddb61cd5 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
40462025-08-28T21:47:38.836ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = b0579848-794a-45c7-a07c-a7bea50d1e6c roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
40472025-08-28T21:47:38.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = b0579848-794a-45c7-a07c-a7bea50d1e6c resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
40482025-08-28T21:47:38.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2201 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = b0579848-794a-45c7-a07c-a7bea50d1e6c response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
40492025-08-28T21:47:39.853ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6e376f8b-ec24-43b4-8866-0e259231b782 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
40502025-08-28T21:47:39.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6e376f8b-ec24-43b4-8866-0e259231b782 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
40512025-08-28T21:47:39.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2378 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6e376f8b-ec24-43b4-8866-0e259231b782 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
40522025-08-28T21:47:39.892ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2715 local_addr = [fd00:1122:3344:101::a]:41821 method = GET remote_addr = [fd00:1122:3344:101::d]:45939 req_id = dff630df-1e77-4757-b677-3fadfc3a0555 response_code = 200 uri = /0fe4e55a-5967-4507-9554-6c41366055df
40532025-08-28T21:47:40.868ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = d0836e76-2324-475f-9092-624efb501e84 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
40542025-08-28T21:47:40.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = d0836e76-2324-475f-9092-624efb501e84 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
40552025-08-28T21:47:40.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2536 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = d0836e76-2324-475f-9092-624efb501e84 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
40562025-08-28T21:47:41.886ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 9a6a1ebe-519c-4cb9-830a-4692fef4084a roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
40572025-08-28T21:47:41.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 9a6a1ebe-519c-4cb9-830a-4692fef4084a resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
40582025-08-28T21:47:41.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 3127 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 9a6a1ebe-519c-4cb9-830a-4692fef4084a response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
40592025-08-28T21:47:42.445ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 172 reason = Timeout
40602025-08-28T21:47:42.445ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
40612025-08-28T21:47:42.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
40622025-08-28T21:47:42.447ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40632025-08-28T21:47:42.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
40642025-08-28T21:47:42.450ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
40652025-08-28T21:47:42.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
40662025-08-28T21:47:42.453ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
40672025-08-28T21:47:42.453ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.530846ms iteration = 172 status = {"chicken_switches_updated":false}
40682025-08-28T21:47:42.902ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 118053db-5203-48cb-82de-4d2462263312 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
40692025-08-28T21:47:42.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 118053db-5203-48cb-82de-4d2462263312 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
40702025-08-28T21:47:42.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2351 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 118053db-5203-48cb-82de-4d2462263312 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
40712025-08-28T21:47:43.917ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 053947f5-dd76-4d98-9211-61e70a40601c roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
40722025-08-28T21:47:43.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 053947f5-dd76-4d98-9211-61e70a40601c resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
40732025-08-28T21:47:43.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2472 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 053947f5-dd76-4d98-9211-61e70a40601c response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
40742025-08-28T21:47:44.933ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = ad45cb8c-5a9d-4f24-aff6-f2c36c22841a roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
40752025-08-28T21:47:44.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = ad45cb8c-5a9d-4f24-aff6-f2c36c22841a resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
40762025-08-28T21:47:44.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 2348 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = ad45cb8c-5a9d-4f24-aff6-f2c36c22841a response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4
40772025-08-28T21:47:45.950ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6201a74d-f8b0-47ad-afc7-14d276968338 roles = RoleSet { roles: {} } uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
40782025-08-28T21:47:45.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6201a74d-f8b0-47ad-afc7-14d276968338 resource = Database result = Ok(()) uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
40792025-08-28T21:47:45.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:867 latency_us = 3907 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41043 req_id = 6201a74d-f8b0-47ad-afc7-14d276968338 response_code = 200 uri = /probes/af8277ed-838c-4274-8629-14eae35fd0e4